-- Logs begin at Fri 2022-01-28 01:08:37 UTC, end at Fri 2022-01-28 02:24:58 UTC. -- Jan 28 01:45:47.439375 dv-cinder-824977-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 28 01:45:47.450847 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:45:47 2022] *** Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: nodename: dv-cinder-824977-1-iscsi Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: machine: x86_64 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: clock source: unix Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: pcre jit disabled Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: detected number of CPU cores: 4 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: current working directory: / Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: your processes number limit is 47680 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: your memory page size is 4096 bytes Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: detected max file descriptor number: 2048 Jan 28 01:45:47.452544 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: lock engine: pthread robust mutexes Jan 28 01:45:47.454870 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: thunder lock: enabled Jan 28 01:45:47.454870 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 28 01:45:47.454870 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:45:47.498739 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: Python main interpreter initialized at 0x56143bbd79c0 Jan 28 01:45:47.498739 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: python threads support enabled Jan 28 01:45:47.498739 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: your server socket listen backlog is limited to 100 connections Jan 28 01:45:47.498739 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:45:47.499292 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:45:47.499292 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: *** Operational MODE: preforking *** Jan 28 01:45:47.499620 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:45:47.499620 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: spawned uWSGI master process (pid: 79730) Jan 28 01:45:47.499681 dv-cinder-824977-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 28 01:45:47.500955 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: spawned uWSGI worker 1 (pid: 79742, cores: 1) Jan 28 01:45:47.500955 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: spawned uWSGI worker 2 (pid: 79743, cores: 1) Jan 28 01:45:47.500955 dv-cinder-824977-1-iscsi devstack@keystone.service[79730]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:45:54.885798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:45:54.885798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: from cryptography.utils import int_from_bytes Jan 28 01:45:54.886768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:45:54.886768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: from cryptography.utils import int_from_bytes Jan 28 01:45:54.887835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:45:54.887835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: from cryptography.utils import int_from_bytes Jan 28 01:45:54.888336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:45:54.888336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: from cryptography.utils import int_from_bytes Jan 28 01:45:54.974043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:45:54.974324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:45:54.974626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] command line args: [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:45:54.975049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:45:54.975331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ================================================================================ {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:45:54.975591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:45:54.975752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] admin_token = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.975901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:45:54.976198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] config_dir = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.976294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] command line args: [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:45:54.976559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.976685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:45:54.976988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ================================================================================ {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:45:54.977584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] config_source = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.977939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] admin_token = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.978394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] config_dir = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.978653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] debug = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.978758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.978955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] config_source = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] debug = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.979947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.980235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.980342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.980650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.980758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_config_append = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.981844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_config_append = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_dir = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_dir = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_file = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_file = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.982900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.983082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.983252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.983430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.983628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.983817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.984928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.985893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.986080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.986289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.986415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.986680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.986803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.987064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.987261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.987463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.987589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.987873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.988027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.988425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.988785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.989184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] publish_errors = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.989336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.989536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] publish_errors = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.989865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.990605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.990753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.990878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.991835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] standard_threads = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.992113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] standard_threads = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.992244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.992528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.992717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.992903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] use_journal = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] use_json = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] use_journal = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.993923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] use_stderr = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] use_json = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] use_syslog = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] use_stderr = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] use_syslog = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.994799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.994946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:45:54.995208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.995346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.995671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.995803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.996114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.996265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.996538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.996674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.996937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.997064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.997335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.997466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.997731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.997868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.998131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.998274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.998542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.998667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.998946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.999084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.999344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.999488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.999739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:54.999871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.000163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.000325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.000563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.000698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.000986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.001130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.001385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.001531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.001783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.001931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.002188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.002318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.002590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.002741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.002989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.003142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.003414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.003549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.003841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.004022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.004286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.004434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.004681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.004826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.005068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.005193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.005465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.005665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.005883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.006064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.006314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.006460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.006739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.006881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.007338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.007756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.007892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.008313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.008762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.009192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.009564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.009952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.010309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.010687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.010884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.011089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.011338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.011478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.011941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.012183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.012330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.012460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.012642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.012831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.013040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.013243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.013445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.013675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.013852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.014076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.014260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.014485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.014638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.014886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.015043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.015296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.015438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.015703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.015868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.016160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.016305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.016561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.016711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.016970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.017118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.017368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.017502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.017771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.017901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.018178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.018323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.018601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.018741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.018990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.019128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.019387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.019537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.019783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.019922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.020192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.020560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.022230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.022670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.023027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.023113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.023457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.023543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.024420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.024523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.024854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.024970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.025266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.025351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.025668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.025759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.026374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.026525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.026525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.026744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.027702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.028188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.028506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.028626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.029095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.029546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.030407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.030558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.030850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.031286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.031724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.032980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.033336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.033416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.033746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.033834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.034156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.034236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.034551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.034637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.034941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.035107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.035337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.035433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.035736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.035839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.036151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.036263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.036557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.036654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.036954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.037049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.037369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.037473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.037766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.037857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.038193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.038288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.038623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.038729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.039024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.039116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.039993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.external = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.040138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.external = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.040399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.040491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.040905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.041010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.041297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.041393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.041692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.password = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.041788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.password = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.042080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] auth.token = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.042177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] auth.token = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.042494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.042639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.042886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.043019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.043303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.043428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.043691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.043817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.044142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.044275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.044557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.044683 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.044947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.045071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.045351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.045531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.045767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.045899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.046184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.046319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.046597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.046732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.046994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.047117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.047407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.047534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.047808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.047944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.048252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.048385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.048680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.048801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.049080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.049199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.049508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.049628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.049984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.050107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.050399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.050519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.050836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.050960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.051249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.051370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.052931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.053056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.053294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.053422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.053682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.053809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.054100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.054231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.054499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.054629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.054959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.055102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.055362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.055491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.055800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.056055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.056259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.056468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.056688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.056897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.057098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.057310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.057531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.057740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.057963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.058151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.058373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.058601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.058785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.058965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.059210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.059386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.059610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.059785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.060078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.060269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.060513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.060701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.060946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.061137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.061351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.061594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.061800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.061929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.062133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.062329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.062563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.062759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.062994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.063226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.063590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.063701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.064043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.064157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.064459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.064584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.064909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.065018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.065311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.065422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.065708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.065827 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.066999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.067274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.067383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.067682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.067790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.068125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.068287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.068663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.068780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.069064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.069179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.069477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.069596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.069892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.070003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.070290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.070401 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.070738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.070868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.071208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.071641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.071876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.072080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.072307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.072485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.072718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.072898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.073118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.073309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.073532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.073840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.073951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.074252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.074359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.074666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.074777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.075098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.075208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.075522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.075630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.075913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.076090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.076330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.076439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.076728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.076841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.077142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.077255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.077539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.077654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.077936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.078047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.078333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.078439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.078836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.078956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.079300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.079751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.080259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.080688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.080817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.081116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.081583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.081791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.082039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.082585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.082918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.083354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.083561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.083764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.084011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.084257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.084446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.084656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.084878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.085088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.085287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.085518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.085691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.085945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.086104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.086974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.087088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.087396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.087482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.087790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.087869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.088242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.088413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.088642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.088786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.089917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.090465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.090551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.090869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.090996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.091266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.091360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.091663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.091746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.092954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.093271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.093405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.093666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.093749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.094957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.095264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.095344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.095664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.095742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.096984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.097299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.097382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.097696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.097775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.098094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.098175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.098508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.098587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.098907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.099041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.099300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.099443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.099695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.099830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] role.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.100130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.100224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] role.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.100562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.100670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.100921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.101005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.101315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.101396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.101713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.101808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.102270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.102381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] role.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.102645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] role.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.102824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.102906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.103239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.103335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.103498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.103682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.103764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.104933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.105863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.106958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.107886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.108979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.109864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.110965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.111817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.112963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.113918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.114992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.connection = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.115908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.116892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.117036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.117174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.117310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.117925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.118204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.118357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.118556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.118790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.118923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.119943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.120919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:45:55.121163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.121569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.122038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.122470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.connection = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.122878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.123306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.123718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.124161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.124561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.124955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.125347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.125739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.126143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.126580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.127005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.127417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.127846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.128270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.128692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.129088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.129487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.129881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:45:55.130156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:45:55.160902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.161280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.161676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.172006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.172495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.173333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.173333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.188223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.202805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.203031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.220410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.220762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.259413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.285829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.310524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.310743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.325065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.325289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.476358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.476682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.477216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.477528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.477897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.478027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.495077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.495319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.496039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.496039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.496039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.496377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.502642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.502874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.503102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.503326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.503546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.503761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.504017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.511210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.511467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.511703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.512052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.512319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.512601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.512759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.517458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.521463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.531525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.531760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.531954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.532243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.532618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.532809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.533023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79742) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.533285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.533527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.533750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.533980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.534187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.534402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.534631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79743) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:45:55.550861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.551129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:45:55.551302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.551462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:45:55.551599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.551599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:45:55.551842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:45:55.552383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.552911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.563605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.563864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.564062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.564206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.564351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.564492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.564648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.565000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.574167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.574317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.577445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.577622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.577753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.577885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.577994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578619 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.578933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.579998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.580151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.580236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.580471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.609536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.610355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.611297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.611614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.612145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.612431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.617206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.618014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.618319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.618481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.618643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.618903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.625704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.625987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.626292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.626577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.630480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.630776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.631056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.631339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.631559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.631687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.631830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.632047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.632219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.632341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.632617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.632739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.633169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.634024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.634510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.634828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.652231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.652515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.653733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.654021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.657394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.658549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.661220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.661528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.662294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.662646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.666733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.667648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.670327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.671311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.673945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.674242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.674525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.674822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.674995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.675087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.675294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.675393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.675577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.675870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.676172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.676450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.695319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.695676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.696529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.696716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.696869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.696992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.697119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.697392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.703897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.707253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.707421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.707546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.710336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.710746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.710874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.711093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.711906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.712328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.712544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.717415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.717737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.718014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.718365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.718651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.727182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.727514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.727926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.728431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.728801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.729162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.729547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.734177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.734532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.734879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.735320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.735649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.735935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.736301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.748818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.752076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.755342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.755478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.757080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.759336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.759452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.759612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.759893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.762652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.764370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.765991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.766266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.766546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.767220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.768838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.772260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.772562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.772845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.773123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.773982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.775576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.778963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.779251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.779533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.779806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.782927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.783245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.783538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.788834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.789125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.789434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.791591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79742) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.791872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.792338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.792563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.792838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.793111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.793411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.793718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.794010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.794297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.794571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.794843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.795149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.795416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79742) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.797236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79743) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:45:55.797525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.797920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.798203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.798484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.798764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.799039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.799305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.799575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.799898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.800274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.800536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.800807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.801077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79743) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:45:55.834651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x56143bbd79c0 pid: 79742 (default app) Jan 28 01:45:55.838512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1b37-4471-40e0-9fbb-33dc0d8bbfe8 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:45:55.838822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1b37-4471-40e0-9fbb-33dc0d8bbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:45:55.839101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b1b37-4471-40e0-9fbb-33dc0d8bbfe8 None None] PATH_INFO: `/v3` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:45:55.840701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x56143bbd79c0 pid: 79743 (default app) Jan 28 01:45:55.843724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Fri Jan 28 01:45:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:05.548754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:05.549367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:05.549367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:05.555242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:05.563015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:05.563519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:05.563602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:05.596257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG oslo_db.sqlalchemy.engines [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:46:05.802600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG passlib.handlers.bcrypt [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79742) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:46:05.802950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG passlib.handlers.bcrypt [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79742) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:46:05.862218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:05.863922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:06.047008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:06.222531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:06.262034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG oslo_db.sqlalchemy.engines [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:46:06.409773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ab4ab-ead2-4e9a-995e-d03446e9a51c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:06.415224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:06.415961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:06.416330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:06.416648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:06.425893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:06.479524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:46:06.479870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf12f4-af79-4c67-bf4e-d936024bfd02 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:06.490606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:06.498383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:06.514616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5832ed8-e0e6-4d3a-b722-57a944b52dd9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:06.519354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:06.520537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:06.520819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:06.521099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:06.522664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ed384f6c4594ad68721f19ac9473b0e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:06.578591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:46:06.579237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71a323-7ec6-43aa-bcf9-e59aa9ad89c5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:06.583920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:06 2022] GET /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:08.902986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a345e1-3eba-401d-8c31-14a0b25e8f06 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:08.903646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a345e1-3eba-401d-8c31-14a0b25e8f06 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:08.903646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a345e1-3eba-401d-8c31-14a0b25e8f06 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:08.908074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:08.916614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:08.917071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:08.917156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:08.937778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:08.939331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:08.948166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:08.973716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a345e1-3eba-401d-8c31-14a0b25e8f06 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:08.987550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a345e1-3eba-401d-8c31-14a0b25e8f06 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:08.992372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:08.993083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:08.993386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:08.993744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:09.001789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:09.003564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261f94-9c14-4847-ad8e-adc2ce5360ee admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:09.013074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:09.019719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:09.029193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5900-0337-4665-999a-7ce1cc4c905e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:09.033818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:09.034683 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:09.034972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:09.035252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:09.036687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:09.039034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb9e2b-b869-43bd-b91a-4edcdcc43887 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:09.040667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:09 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:11.332454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1df4-4fdf-4b81-8dea-797f1469d9a7 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.332966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1df4-4fdf-4b81-8dea-797f1469d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.333082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1df4-4fdf-4b81-8dea-797f1469d9a7 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.334776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:11.343462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.344112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.344112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.361973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:11.363161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:11.369405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004ed6-1642-4241-9cfe-dfa3b4c3d053 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.369695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004ed6-1642-4241-9cfe-dfa3b4c3d053 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.369981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00004ed6-1642-4241-9cfe-dfa3b4c3d053 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.371750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:11.372249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:11.379100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.379392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.379673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.397619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.406855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bfc40-5bd3-4beb-85e2-f4a86058aab4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.412323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.412323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.412631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.412902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.423641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG passlib.handlers.bcrypt [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79743) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:46:11.424104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG passlib.handlers.bcrypt [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79743) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:46:11.426283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:11.433652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:11.435125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 7/13] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:11.443137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.454230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1da073-5b82-44a8-af8c-927f397874ef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.458852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.459630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.459910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.460314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.461270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:11.461571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.463379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:11.463379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:11.463379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:11.464413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.471662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:11.473361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:11.478686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 8/14] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:11.484722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.495439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f29265-207c-4632-90c3-9d001fbd36aa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.499848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.500747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.501021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.501289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.502474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.504320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.506119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 9/15] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:11.512347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 7/16] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:11.512726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.522412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69da60-26be-499b-ace1-f70f9ef0ab20 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.528422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.529237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.529510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.529785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.530957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.532692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.534372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 10/17] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:11.535344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.540871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.545253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba99179-f49a-442f-ae4a-24b1c92c1d8c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.550035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.551020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.551164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04db72-26d2-4540-8be8-8011f5bca8f0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.551284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.551569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.556558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.557662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.558133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.558486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.559744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.domain.id=default, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:11.560065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.561098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:11.561098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:11.561098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:11.561461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.562285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.563105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed170a9-91ea-4d5f-9493-366ac401acb0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.569582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 11/18] 10.222.0.79 () {56 vars in 1343 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.domain.id=default&role.id=696ce32a0d804992a93645d6906b0119 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:11.573554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 8/19] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:11.580076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:11.591634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1d87-47ed-4233-9829-2e1ec3e8b273 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:11.596589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:11.597399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:11.597680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:11.597950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:11.599270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:11.601192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed5d48-5659-468b-b3fe-1734e6568d42 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:11.602866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 12/20] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:14.277843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb0c7-0c45-40bd-b8ac-051dc44394ff None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.278949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb0c7-0c45-40bd-b8ac-051dc44394ff None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.279436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb0c7-0c45-40bd-b8ac-051dc44394ff None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.281705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 9/21] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:14.293193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0cf8-232e-4a84-a80a-52fe96f385b4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.293193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0cf8-232e-4a84-a80a-52fe96f385b4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.293193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f0cf8-232e-4a84-a80a-52fe96f385b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.321345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9a4f0cf8-232e-4a84-a80a-52fe96f385b4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:14.322874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9a4f0cf8-232e-4a84-a80a-52fe96f385b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:14.331691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 13/22] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:14.371197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb0c7-0c45-40bd-b8ac-051dc44394ff None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.393150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb0c7-0c45-40bd-b8ac-051dc44394ff None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.398936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.399789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.400106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.400382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.432670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.434623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.458289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:14.459879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 10/23] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:14.462438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e886b-4642-4ec6-bee7-d9c57264f30c None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.462967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e886b-4642-4ec6-bee7-d9c57264f30c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.463451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e886b-4642-4ec6-bee7-d9c57264f30c None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.468432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 14/24] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:14.468718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.476653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.477273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.477749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.484348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6dc5b-a765-4502-b38b-3e10a2d17964 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.490884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.493028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.493028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.493028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.493698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:14.494011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.495778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:14.495778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:14.495778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:14.496739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.517109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:14.518695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:14.532007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 11/25] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:14.538397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.539200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 15/26] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:14.548896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ad3d7-f3f5-4fe4-85d9-fab62c2ecf8c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.559410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.560112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.560498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.560784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.561730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.562908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:14.562908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:14.562908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:14.564176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77143d20-8206-4590-a165-d8dcfe90a637 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.571914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.594377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3175c4a-7237-4471-923e-d62ba25e0239 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.608755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.609961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.610432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.610886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.641228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:14.649443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:14.650420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 16/27] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:14.657147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.670126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b64f4-438c-479c-b247-26dfb6597c96 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.683197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.696197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.698743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 17/28] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:14.704596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.732446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f69e-6d37-4e36-98bb-e7165aab6812 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.761976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.763857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.764592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.765260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.773330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.776986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.780152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 18/29] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:14.787280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.815037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e96813-1d22-42c6-b922-f5b8de35a6a2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.835856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.837576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.838274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.838958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.845312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.848560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0a372-19ab-401c-9acd-1836e97d1714 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.852202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 19/30] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:14.860006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefaa1-69a8-4f05-b077-250a33f3be45 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.860911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefaa1-69a8-4f05-b077-250a33f3be45 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.861544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefaa1-69a8-4f05-b077-250a33f3be45 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.865171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 20/31] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:14.867347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cefaa1-69a8-4f05-b077-250a33f3be45 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:14.911677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cefaa1-69a8-4f05-b077-250a33f3be45 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:14.929682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:14.933623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.941486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 12/32] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:46:14 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:14.942372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.943052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] PATH_INFO: `/v3/domains/default/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:14.947793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3562fb362d174fe499304c112522dca6, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:14.950004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:14.950004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:14.950004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:14.954580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944340d-2948-4e44-aac3-db7efa7ae8e8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:14.957788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:14.958540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:14.959214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:15.018447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:15.021801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:15.190835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 13/33] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:15.242302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:15.252581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984e5ec-504b-4aaa-9790-82e7e0032b3e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:15.384067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:15.384901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:15.385227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:15.386148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:15.386326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:15.387509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:15.387509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:15.387509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:15.388472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:15.403541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 21/34] 10.222.0.79 () {58 vars in 1382 bytes} [Fri Jan 28 01:46:14 2022] PUT /identity/v3/domains/default/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:15.443269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb51b7-2b2f-4524-9b45-945628461f16 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:15.443800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb51b7-2b2f-4524-9b45-945628461f16 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:15.444397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb51b7-2b2f-4524-9b45-945628461f16 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:15.450871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 22/35] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:15.458845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fd35-80c8-4a36-bdf2-d793f0d1c2f4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:15.459449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fd35-80c8-4a36-bdf2-d793f0d1c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:15.459955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fd35-80c8-4a36-bdf2-d793f0d1c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:15.490373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 14/36] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 01:46:15 2022] POST /identity/v3/roles => generated 219 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:15.493455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6a47fd35-80c8-4a36-bdf2-d793f0d1c2f4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:15.495110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6a47fd35-80c8-4a36-bdf2-d793f0d1c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:15.508704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 23/37] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:15.548766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:15.564702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4774e9c-30a1-4f95-aa21-98c3765d37a6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:15.571631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:15.572783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:15.573297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:15.573742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:15.574751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:15.576831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61747faf-203c-4c71-98d6-5c3871a7d741 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:15.706241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 15/38] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 01:46:15 2022] POST /identity/v3/roles => generated 225 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:16.252464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52034e-af96-4a62-aebd-765025b5ff3e None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.252832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52034e-af96-4a62-aebd-765025b5ff3e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.253026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52034e-af96-4a62-aebd-765025b5ff3e None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.255076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 24/39] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:16.263491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe235a4-4467-4d8b-8f0d-dd298843a382 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.263799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe235a4-4467-4d8b-8f0d-dd298843a382 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.264085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe235a4-4467-4d8b-8f0d-dd298843a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.283609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-6fe235a4-4467-4d8b-8f0d-dd298843a382 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:16.284841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6fe235a4-4467-4d8b-8f0d-dd298843a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:16.293899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 16/40] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:16.322565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52034e-af96-4a62-aebd-765025b5ff3e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:16.334385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c125-e871-405a-a6ef-dd1957e6f9c2 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.334705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c125-e871-405a-a6ef-dd1957e6f9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.335095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c125-e871-405a-a6ef-dd1957e6f9c2 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.336805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52034e-af96-4a62-aebd-765025b5ff3e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:16.337667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 17/41] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:16.342053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:16.342729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.343016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.343297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.344463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:16.345701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:16.345701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:16.345701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:16.346554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.346725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb490e-3bb6-419a-ba82-266ca1640429 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:16.347387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.347984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.368165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:16.369396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:16.377707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 18/42] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:16.401426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:16.410514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dfed3-600c-428e-ab84-4aecacb98466 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:16.416155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:16.416956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.417256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.417516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.418735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:16.420581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:16.422241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 19/43] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:16.429476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:16.440792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b6267-6206-46de-bc3c-572e25c443ae admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:16.446341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:16.447064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:16.447408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:16.447764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:16.448642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:16.450755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6c4d0-d4a6-43a0-80ce-cd96962a6bf7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:16.471953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 25/44] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 01:46:16 2022] POST /identity/v3/roles => generated 223 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:16.597855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 20/45] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:46:16 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:17.824086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356de033-bc12-49e5-ae7f-9f8589e597d0 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:17.824666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356de033-bc12-49e5-ae7f-9f8589e597d0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:17.824666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356de033-bc12-49e5-ae7f-9f8589e597d0 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:17.826484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 26/46] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:17.835724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:17.836389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:17.836389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:17.855360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:17.856596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:17.917176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 21/47] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:17.942981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356de033-bc12-49e5-ae7f-9f8589e597d0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:17.956391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356de033-bc12-49e5-ae7f-9f8589e597d0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:17.961774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:17.962546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:17.962829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:17.963104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:17.974517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:17.982032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:17.983203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 27/48] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:17.991028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.001844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098452d-7236-4b44-8bdb-2dd9285cc926 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.006879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.007551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.007836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.008154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.008913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:18.009223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.010243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:18.010243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:18.010243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:18.011147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:18.025890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 22/49] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:18.032195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.043004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11745f46-98f1-4c56-81fa-bf944816c501 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.047624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.048635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.048918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.049198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.050427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.052322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:18.054579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 28/50] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:18 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:18.060677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.071075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef85d-4988-437f-8910-f3dc09f40153 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.076141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.076906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.077194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.077484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.078726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.080500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ff404-a0c9-449f-b34d-bf519a290b99 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:18.082144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 23/51] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:18.089106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.099259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671205d-0230-4a3e-9f1a-ca9975e49015 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.104479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.105129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.105421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.105704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.106599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.domain.id=default, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:18.106910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.109007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cc2fb-fc36-4df7-b727-5a2b9f5b4e11 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:18.114991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 29/52] 10.222.0.79 () {56 vars in 1343 bytes} [Fri Jan 28 01:46:18 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.domain.id=default&role.id=696ce32a0d804992a93645d6906b0119 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:18.864360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a36c-3a68-4535-bbb8-451a06f56511 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.864981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a36c-3a68-4535-bbb8-451a06f56511 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.864981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6a36c-3a68-4535-bbb8-451a06f56511 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.867286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 24/53] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:18.875594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.876061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.876227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.894812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:18.896164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:18.904845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 30/54] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:18.928365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a36c-3a68-4535-bbb8-451a06f56511 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.941692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6a36c-3a68-4535-bbb8-451a06f56511 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.947257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.948058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.948343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.948650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.949814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.951508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b9b7f-15ee-4ac9-be2b-ea9f363e69a9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:18.953141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 25/55] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:18.960420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:18.970601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcf286-e243-447e-bda7-4a490d26b03c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:18.974996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:18.975629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:18.976642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:18.976642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:18.977111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:18.978127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:18.978127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:18.978127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:18.979325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908b243-2487-4bc3-9e17-cd0a0d62d807 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:19.089341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 31/56] 10.222.0.79 () {60 vars in 1161 bytes} [Fri Jan 28 01:46:18 2022] POST /identity/v3/projects => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:21.370256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-c08b-4769-b413-2a9e64f75e25 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:21.370806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-c08b-4769-b413-2a9e64f75e25 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:21.370806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-c08b-4769-b413-2a9e64f75e25 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:21.372723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 26/57] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:21.380715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:21.381191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:21.381286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:21.400217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:21.401321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:21.464171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 32/58] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:21.490749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59d7d-c08b-4769-b413-2a9e64f75e25 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:21.503720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59d7d-c08b-4769-b413-2a9e64f75e25 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:21.508349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:21.509132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:21.509417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:21.509697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:21.510871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:21.512611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0959b88-7557-406a-95ab-d584e22e8cc1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:21.514205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 27/59] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:21.520339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:21.530266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690b73-cb7e-44bc-8591-f0e6874ae8c4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:21.534655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:21.535314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:21.535618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:21.535899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:21.536685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:21.538304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:21.538304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:21.538304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:21.543555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19458261-a940-40ad-851e-cc4149eac265 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:21.683014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 33/60] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:21 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:25.305226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679962da-165d-4e73-8baa-d5048174ef1b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.306128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679962da-165d-4e73-8baa-d5048174ef1b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.306610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679962da-165d-4e73-8baa-d5048174ef1b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.308978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 28/61] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:25.317613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.318181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.318904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.359862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:25.362082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:25.379548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 34/62] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:25.450071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679962da-165d-4e73-8baa-d5048174ef1b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.463567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679962da-165d-4e73-8baa-d5048174ef1b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.472498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.473391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.473682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.473967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.494500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:25.501746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:25.503317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 29/63] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:25.510617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.526270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244cc79-156d-4ed3-bd44-727b8a2a41df None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.536670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.538124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.538552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.538962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.540072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:25.540520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.542307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b9fe3-da2e-4c12-a408-f173ffc4e0fe admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.555645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 35/64] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.562304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.573731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07bee-ac2b-490c-af72-04cfa6f35bce admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.579999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90ea2-edac-4a75-a24d-d5d9999e7cef None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.580307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90ea2-edac-4a75-a24d-d5d9999e7cef None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.580590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90ea2-edac-4a75-a24d-d5d9999e7cef None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.581528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.582510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 36/65] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:25.582614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.582767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.583023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.604125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.604339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.604417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.604684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.606601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.608682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 30/66] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.614436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.631754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530457-5e0b-4f7f-a950-aca344eb8c54 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.640880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.641541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.641830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.642113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.643634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:25.644891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:25.660360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 37/67] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:25.663168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.665406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.675518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 31/68] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:25.681839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.697850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fa9a5-33d0-4e76-a0ef-3de54a0d83ec None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.702421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.703273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.703559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.703838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.705054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.707157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.712385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 38/69] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.713823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.724300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.728379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e4fde-8ed6-4994-8fe8-20cc038049b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.739265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.740124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.740416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.741235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.747503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59568-a3fe-4c34-93db-281d3fe752fd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.752330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.753014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.753302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.753584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.754464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:25.754780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.757688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.764345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:25.772343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:25.773837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 39/70] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=e41adb3856204ccab507dffc30b49ede => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.774358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 32/71] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:25.781724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.802180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e88260-07c1-40fd-bb08-052ed16d81cf admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.808964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.810118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.810421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.810738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.812162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:25.812650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.814707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f181f-6e6e-448b-ab01-246b8cad7a71 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.831719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 40/72] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.839006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.865335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2493c6f-6e81-4e07-997c-961be7c4c656 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.872705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.873604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.873835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c967-6b1a-417d-8068-eb4698387253 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.874193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c967-6b1a-417d-8068-eb4698387253 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.874406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.874522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c967-6b1a-417d-8068-eb4698387253 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.874928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.876644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 41/73] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:25.880485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.886303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.887005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.887598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.890793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:25.895455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 33/74] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:25.919306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:25.921043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:25.930528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 42/75] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:25.937090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.953721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86944755-b66c-47c2-a89d-0d0c4a18e2a7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.956300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:25.966413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.967456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.969181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.969692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.972995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646a4d-d815-41d5-ab2f-910e08915a54 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:25.983241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:25.984417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:25.984954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:25.985441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:25.985543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:25.987348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c556b-de93-48ad-bf19-fe3ca0235027 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.002120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 34/76] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:26.004938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fb7-d95c-453f-8844-cc89048fd2c0 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.004938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fb7-d95c-453f-8844-cc89048fd2c0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.004938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4fb7-d95c-453f-8844-cc89048fd2c0 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.008810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:26.013361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 35/77] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:26.013361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4fb7-d95c-453f-8844-cc89048fd2c0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.014845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5ddb4247-f4a8-4620-b2c5-5565e3c48158 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:26.016337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 43/78] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:26.020501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.020797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.021081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.034975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4fb7-d95c-453f-8844-cc89048fd2c0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.042367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.043578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.043790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:26.044284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.044776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.045354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:26.046553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.049109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.051421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 36/79] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:26.052741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.060148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 44/80] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:26.061254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.065850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b07d7-b6bc-4142-ac42-0817bb307201 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.079899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d7b01-b188-47c6-8985-3e0aa82e6358 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.082104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.083179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.083681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.084201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.085277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:26.086701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.088548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.093236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.094301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.094870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.095377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.096532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:26.097089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.099343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 37/81] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.099567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.106209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.110497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 45/82] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.111699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.119298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee74a7-584f-40ce-9197-119e4a1977e1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.123696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c430-b055-4355-ab99-187d0cabf9ef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.125161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.126022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.126368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.126655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.128313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.130490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.131835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.132435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.132941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.134527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.136293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.137405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.139746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 46/83] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.144535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 38/84] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.148768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.153099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.160199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8e8d6-7054-474c-9a77-bd1d72868c58 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.165993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.166730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.167022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.167306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.168195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913f3fb-7616-4edc-b5a5-75248c465638 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.168330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.170619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.173784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.175032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.175526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.176425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.187500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.190709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92414d21-18c2-4c31-a063-7593d9576ce5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.201343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 39/85] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:26.202935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa530-64fd-4855-8667-3a7330a6a6bd None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.212198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa530-64fd-4855-8667-3a7330a6a6bd None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.212198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7aa530-64fd-4855-8667-3a7330a6a6bd None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.212198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 40/86] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:26.212198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aa530-64fd-4855-8667-3a7330a6a6bd None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.221595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7aa530-64fd-4855-8667-3a7330a6a6bd None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.230135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.231581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.232092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.232561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.234634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.238369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243859e-a9c2-45f3-b4d5-9760a014d166 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.242442 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 41/87] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:26.244492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.246763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.246763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.273506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:26.275446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:26.288452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 42/88] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:26.289789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.306723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ec5a0-3feb-45ba-bf1a-579606b4d26f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.314599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.315805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.316362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.316832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.318423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:26.319808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.321432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:26.321432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:26.321432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:26.322943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.323752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 47/89] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:46:26 2022] POST /identity/v3/projects => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:26.330033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.338816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 43/90] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=f64957bf427046ef80071913d3681efc => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.417047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01487-7862-4922-ba9d-ed49ea5f47fc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.426592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.427776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.428602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.429162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.447389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:26.455262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:26.456981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 48/91] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:26.464419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.480240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeeb5a7-80a8-44b3-8500-3468f46b038b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.488446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.489762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.490388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.491063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.492543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:26.493140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.495236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.509691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 44/92] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:26.516249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.532448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a854d-bde1-448d-b60c-4167dd8dc22b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.539399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.540926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.541497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.542080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.549133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.551916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.554069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 49/93] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:26.561635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.572789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb502ec-8ec4-4e3f-9ae3-5b0defe6236b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.578300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.579233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.579710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.580294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.590629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.592948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.603954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 45/94] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:26.610736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.621620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e337-b983-40b9-93cb-7fcb247e7b36 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.626573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.627701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.628251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.628724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] PATH_INFO: `/v3/projects/df95a8b4ec584d53a62e35e19faf8f00` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.630151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] RBAC: Authorizing `identity:get_project(project_id=df95a8b4ec584d53a62e35e19faf8f00)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.632814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd78a55-95a4-4d4f-844a-1fe6615a0ab0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.634905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 50/95] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/projects/df95a8b4ec584d53a62e35e19faf8f00 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:26.641757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:26.652271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b367-0008-4850-8830-9ade0cba6d50 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:26.657200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:26.658165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:26.658720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:26.659187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:26.660397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=df95a8b4ec584d53a62e35e19faf8f00, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:26.660942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:26.663959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990f6d2-84ca-43a2-946b-c305d98dd7f7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:26.670783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 46/96] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:26 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=df95a8b4ec584d53a62e35e19faf8f00&role.id=e41adb3856204ccab507dffc30b49ede => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.005257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22210d-5400-4ed8-9ee2-22afc8e5a539 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.005801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22210d-5400-4ed8-9ee2-22afc8e5a539 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.005801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22210d-5400-4ed8-9ee2-22afc8e5a539 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.008531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 51/97] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:29.016684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.017189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.017292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.026023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18ca3-ffaf-4268-a3d6-ccd3595f62fd None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.026490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18ca3-ffaf-4268-a3d6-ccd3595f62fd None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.026963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18ca3-ffaf-4268-a3d6-ccd3595f62fd None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.030286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 52/98] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:29.039017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.039382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.039664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.076487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:29.078434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:29.081997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:29.083477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:29.097131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 47/99] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:29.107708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 53/100] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:29.128384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.142925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33fba-5147-4e36-800c-8b1d1c5f305d None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.148113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.148838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.149124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.149401 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.151081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.162304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f8ad9-034a-408e-9a92-9b2159b64895 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.170662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.171463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.171742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.172041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.180572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:29.187313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:29.188570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 48/101] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:29.203354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.204358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:29.218091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:29.219367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 54/102] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:29.225159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbe522-40e2-440e-af80-c5393dfdff6e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.226831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.237399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.238087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.238371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.238652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.239424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:29.239735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.241594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.247136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185909-5858-4125-a9bd-0c551b6ec9c3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.253389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.254073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.254366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.254643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.255467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:29.255719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.258614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.265430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 49/103] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.275292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 55/104] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:29.277133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.282226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.291996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6def0a-a8f4-4d96-9610-f605f444c6d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.296389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.297263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.297547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.297827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.300527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ee15e-da19-4777-88ff-cdb4c9ddb9c5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.302211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.304639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.306529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 50/105] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.311371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.313140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.313796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.314087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.314365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.316032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.323385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.325411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 56/106] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.330910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494c085-7915-4d08-b3cb-e5801948f57b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.331783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.349344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231b5fe-3ab8-4ecc-b60f-969b6ddaa99a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.350377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.351563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.352093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.352624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.354517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.357279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.360863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 51/107] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.368473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.369667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.369869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.370435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.371011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.372452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.374800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743795b5-2163-45ec-9c12-3fecc1e6e547 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.377117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 57/108] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:29.378667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e90e-bbd0-4393-a520-a2fcb7a4ef3a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.379168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e90e-bbd0-4393-a520-a2fcb7a4ef3a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.379650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898e90e-bbd0-4393-a520-a2fcb7a4ef3a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.380190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5d759-54f0-41f5-9c7e-6435f92e5428 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.382786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 58/109] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:29.390870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e90e-bbd0-4393-a520-a2fcb7a4ef3a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.395374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.396261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.396586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.396869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.401915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33926690fbc24a2d8d30cdff9ed944f5, user_id=3562fb362d174fe499304c112522dca6, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.403021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:29.403021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:29.403021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:29.405140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65d816-f198-43de-93b1-955aca2b6ef1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.416120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898e90e-bbd0-4393-a520-a2fcb7a4ef3a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.429701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.430607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.430951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.434759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.434759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33926690fbc24a2d8d30cdff9ed944f5, user_id=b29bca7ca3e643e9ac1fc62f9fefa20b, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.436292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.500049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 52/110] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:29 2022] PUT /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:29.500049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3574-7f1f-4730-a3c7-f6043f84afe5 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.500049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3574-7f1f-4730-a3c7-f6043f84afe5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.500049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3574-7f1f-4730-a3c7-f6043f84afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.520238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2daf3574-7f1f-4730-a3c7-f6043f84afe5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:29.521386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2daf3574-7f1f-4730-a3c7-f6043f84afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:29.532881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 59/111] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:29 2022] PUT /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:46:29.619176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 53/112] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:29.664364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.754853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861b7c-d19e-4bf9-ade5-31c56e0d60e1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.765238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.766085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.766368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.766642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.780434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84117-c1fc-45de-adba-7ee1aaf80b68 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.780709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84117-c1fc-45de-adba-7ee1aaf80b68 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.781469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c84117-c1fc-45de-adba-7ee1aaf80b68 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.783524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 54/113] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:29.789192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:29.794160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4258f-12ca-4d20-a0b8-71756a2b65a7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.794454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4258f-12ca-4d20-a0b8-71756a2b65a7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.794741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4258f-12ca-4d20-a0b8-71756a2b65a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.797416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:29.798974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 60/114] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:29.807382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.815692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b5d4258f-12ca-4d20-a0b8-71756a2b65a7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:29.817412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491655b-0da3-4b0e-9df0-c9f771053f23 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.817715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b5d4258f-12ca-4d20-a0b8-71756a2b65a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:29.825549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.826687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.827179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.827671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.829147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:29.829909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.830015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 55/115] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:29.833900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.837453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406efa-388a-4eec-99aa-2463b48d05bd None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.837810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406efa-388a-4eec-99aa-2463b48d05bd None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.838043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406efa-388a-4eec-99aa-2463b48d05bd None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.840268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 56/116] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:29.844117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 61/117] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:29.848339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.848620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.848956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.855141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.869200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b124-570d-43a5-a2bb-b979a24cb2b2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.873696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.874632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.874918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.875225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.877252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.879418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.881513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 62/118] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.882278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.885151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:29.886879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:29.892126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3c40-f667-49f5-9113-1df6a603a175 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.895477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 57/119] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 01:46:29.896706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.901382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.902186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.902476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.902754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.904746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.909404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.910559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10dde8-4fb0-4545-9bc6-38064c866e61 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.919243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 63/120] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.921628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.932382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.933548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.934007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.934453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.936088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.936433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1079-3043-431b-bfe2-3efa18996061 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.938565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.940536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 58/121] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:29.941750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:29.942808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.943807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.944191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.944551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.945348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:29.947482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:29.954423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce71e0-94d8-4788-ab9e-dfda06aa6ff4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:29.960040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:29.961114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:29.961592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:29.962040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:29.975953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:29.983345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:29.984930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 59/122] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:29.986019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:30.003470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b6252-39a4-4825-bead-d5025b1e1440 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:30.008885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:30.010062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:30.010541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:30.011037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/f64957bf427046ef80071913d3681efc` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:30.014361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33926690fbc24a2d8d30cdff9ed944f5, user_id=b29bca7ca3e643e9ac1fc62f9fefa20b, role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:30.017901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:30.038401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 64/123] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:29 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:30.038401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:30.051327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ac02-abfc-4f94-a8f1-7d5d5035df7f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:30.057814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:30.059140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:30.059677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:30.060150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:30.061292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:30.061662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:30.063494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:30.075618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 65/124] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:30.082266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:30.094605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e8f3-c026-4e8c-a002-c9a8aa32762c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:30.100744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:30.101765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:30.102061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:30.102347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:30.104005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:30.106546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:30.108644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 66/125] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:30 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:30.115376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:30.120096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 60/126] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:29 2022] PUT /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/f64957bf427046ef80071913d3681efc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:30.131482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862049a-520c-4e26-bdf4-3124b9a3c5fe admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:30.208154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:30.209872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:30.210379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:30.210818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] PATH_INFO: `/v3/projects/df95a8b4ec584d53a62e35e19faf8f00` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:30.212162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] RBAC: Authorizing `identity:get_project(project_id=df95a8b4ec584d53a62e35e19faf8f00)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:30.214880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d02caa-1681-4e56-aac1-0a572f8fe36b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:30.216823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 67/127] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:30 2022] GET /identity/v3/projects/df95a8b4ec584d53a62e35e19faf8f00 => generated 312 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:30.224128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:30.236724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635be-4e91-446e-9aa6-743f5d9e3abb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:30.242129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:30.243141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:30.243432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:30.243771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] PATH_INFO: `/v3/projects/df95a8b4ec584d53a62e35e19faf8f00/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:30.246173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=df95a8b4ec584d53a62e35e19faf8f00, user_id=b29bca7ca3e643e9ac1fc62f9fefa20b, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:30.249251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e213aa1-91b5-4fcb-84cb-2b7fc7de35ce admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:30.342837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 61/128] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:30 2022] PUT /identity/v3/projects/df95a8b4ec584d53a62e35e19faf8f00/users/b29bca7ca3e643e9ac1fc62f9fefa20b/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:32.152218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17014aa7-665b-4df0-8ba5-2317fc21d22f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.152840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17014aa7-665b-4df0-8ba5-2317fc21d22f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.152840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17014aa7-665b-4df0-8ba5-2317fc21d22f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.154871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 68/129] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:32.173663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.175020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.175771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.209762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:32.211297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:32.276144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 62/130] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:32.333450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17014aa7-665b-4df0-8ba5-2317fc21d22f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.358684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17014aa7-665b-4df0-8ba5-2317fc21d22f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.370600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.372353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.373156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.374023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.401611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:32.415729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:32.418299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 69/131] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:32.425287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.442371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c9fc3-6547-466d-a652-112185feb317 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.456910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.458510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.459314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.460082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.461607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:32.462414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:32.465902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:32.485887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 63/132] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:32.493579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.517766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a18c-704d-4ee6-8136-493e40145fe0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.530458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.532375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.533114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.533840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.536236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:32.540046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:32.543381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 70/133] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:32.550218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.569234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0649f4-7c0c-4c2b-93cc-ebd20b79218c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.581003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.582456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.583195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.584765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.605907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:32.609479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:32.627630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 64/134] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:32.635365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.656458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2bd74-cef1-4272-b23e-89ae1aad7a1c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.670629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.672531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.673279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.674027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.676449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:32.681307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741016-64ca-4089-a36d-86b06b801cfa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:32.684700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 71/135] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:32.691868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:32.713598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc880fe5-148b-4bad-beca-c9e40157e456 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:32.725271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:32.726800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:32.727553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:32.728326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:32.730190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:32.731053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:32.734986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaefa0f-6ef3-4fb2-9075-f92c10a15828 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:32.747668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 65/136] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:32 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:33.559013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b659-9813-4a65-87bc-e2049d6a973b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:33.559582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b659-9813-4a65-87bc-e2049d6a973b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:33.559955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b659-9813-4a65-87bc-e2049d6a973b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:33.562855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 72/137] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:33.591452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:33.591954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:33.592438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:33.635894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:33.637940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:33.654605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 66/138] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:33.750727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b659-9813-4a65-87bc-e2049d6a973b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:33.778160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4b659-9813-4a65-87bc-e2049d6a973b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:33.791240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:33.792611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:33.793086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:33.793564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:33.818923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:33.832519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:33.835233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 73/139] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:33.846285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:33.867608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bbf5a-a8bf-43e2-8055-25a099bbaca3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:33.875220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:33.876357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:33.876962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:33.877460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:33.878824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:33.879372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:33.882502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:33.903396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 67/140] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:33.914509 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:33.937838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867c08e-9b65-44d9-b5ad-0005f288bf28 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:33.951250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:33.952756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:33.953218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:33.953838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:33.955885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:33.960816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312ee58-16e3-403d-8ed1-7a49afe1d3f9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:33.964081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 74/141] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:33 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:33.974320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:33.993376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce1b55-9ae4-4763-a5de-d2a94cbb4c03 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.005390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.006674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.007178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.007667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.025854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134119-dccb-4095-9538-12872940290a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.026360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134119-dccb-4095-9538-12872940290a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.026858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134119-dccb-4095-9538-12872940290a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.030256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 75/142] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:34.033756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.039682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b4c-3901-4660-a705-7d481b76e926 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.040209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b4c-3901-4660-a705-7d481b76e926 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.040708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1b4c-3901-4660-a705-7d481b76e926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.043558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.079530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 68/143] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:33 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:34.090267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.093483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e45f1b4c-3901-4660-a705-7d481b76e926 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:34.095368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e45f1b4c-3901-4660-a705-7d481b76e926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:34.106476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eb28d-7c45-4dd3-8429-9312fdd1261a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.120127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 76/144] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:34.121219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.122817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.123305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.123790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.129177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.135706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e25b4-5dcd-4c3f-a4fa-aa7b1fb6b9a3 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.135944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e25b4-5dcd-4c3f-a4fa-aa7b1fb6b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.140009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e25b4-5dcd-4c3f-a4fa-aa7b1fb6b9a3 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.140009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 77/145] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:34.143208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.148702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.149198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.149660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.152515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 69/146] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.163627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.202082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f221-3150-4cbb-b15c-64675025d6ba admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.221100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:34.223046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:34.225409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.226504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.226993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.227479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.229044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:34.229579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.233248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.254296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 70/147] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=e41adb3856204ccab507dffc30b49ede => generated 608 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.257592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 78/148] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:34.259122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.284386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81807-157e-4433-baaf-6c39c4e441b4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.297191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.298977 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.307808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.308268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.308682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.325987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1826320-b67d-4bb5-ba34-e70ab25cae48 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.344501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.345618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.346038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.346451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.356373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:34.387110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:34.389087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 71/149] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:34.395284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:34.404156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.427193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:34.429449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 79/150] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:34.441617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.444972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025618cb-28b4-4e1a-88de-c30177a746b9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.463953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.465315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.465796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.466272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.467609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:34.468178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.471168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.480267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb07ef-864b-481e-afd7-15339f86cefd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.488229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 72/151] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:34.494064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.495184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.495524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.495644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.496146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.497606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:34.498141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.503585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.514953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804218-4b02-47e7-abec-debc24f9a87d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.526239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.527496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.528082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.528589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.530651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 80/152] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:34.531672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.534131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.540003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.540534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 73/153] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.547027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.558570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1d8e-e7a8-44dd-8f34-2cb3fc1c2762 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.570356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deceb73-3b0f-4caa-a011-99657b086441 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.573862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3490-beee-4036-a657-3902c086362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.575221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3490-beee-4036-a657-3902c086362f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.575616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3490-beee-4036-a657-3902c086362f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.576025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c3490-beee-4036-a657-3902c086362f admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.578096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c3490-beee-4036-a657-3902c086362f admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.580081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.581035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.581522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.582011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.582111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c3490-beee-4036-a657-3902c086362f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.590508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 81/154] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.597007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3490-beee-4036-a657-3902c086362f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.600807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.603309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.620090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 74/155] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:34.625459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c3490-beee-4036-a657-3902c086362f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.626632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.641682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83731-ecf7-48a7-b797-7ec95c296ec2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.645129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.646573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.647063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.647533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.652375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.653548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.654030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.654520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.657684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.660285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.663025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 75/156] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:34.669792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.672021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.675260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.685797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873fa96-be11-4a7c-9b5e-15957528bdef admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.694649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.695749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.696431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.696960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.698063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:34.698611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.700803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.705662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 82/157] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:34.712979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.721769 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 76/158] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=f64957bf427046ef80071913d3681efc => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.731884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c6bd-e253-4481-82af-64dada8210d5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.742809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.743678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.743961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.744336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] PATH_INFO: `/v3/projects/df95a8b4ec584d53a62e35e19faf8f00` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.745570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] RBAC: Authorizing `identity:get_project(project_id=df95a8b4ec584d53a62e35e19faf8f00)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.747722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8d942-84e7-41cf-b206-d4b2056cd81b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.749798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 83/159] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/projects/df95a8b4ec584d53a62e35e19faf8f00 => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:34.757346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:34.767813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664cc97-be76-4745-9d29-0e47bc3bfe38 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:34.778299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:34.778977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.779280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.779560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.780441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=df95a8b4ec584d53a62e35e19faf8f00, user.id=b29bca7ca3e643e9ac1fc62f9fefa20b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:34.780760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:34.782710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c467a56-5f9a-4e4d-ad4b-9725fe7e565e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:34.789928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 77/160] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:34 2022] GET /identity/v3/role_assignments?user.id=b29bca7ca3e643e9ac1fc62f9fefa20b&scope.project.id=df95a8b4ec584d53a62e35e19faf8f00&role.id=e41adb3856204ccab507dffc30b49ede => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:34.924661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed2d2-ce7a-4cd6-bf67-454fd25f69ae None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.925157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed2d2-ce7a-4cd6-bf67-454fd25f69ae None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.925467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bed2d2-ce7a-4cd6-bf67-454fd25f69ae None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.928770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 84/161] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:34.949914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:34.950218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:34.950564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:34.981262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:34.982514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:34.993497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 78/162] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:35.043349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed2d2-ce7a-4cd6-bf67-454fd25f69ae None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.059313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bed2d2-ce7a-4cd6-bf67-454fd25f69ae None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.063850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.064680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.064962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.065236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.082609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:35.090304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:35.091570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 85/163] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:35.098233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.108576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44153-914d-4f03-8a4b-fb8653a197b9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.119432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.120491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.120993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.121460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.122448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:35.123004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.124969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.150900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 79/164] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:35.157047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.175083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac4f7f-60d0-42ca-9bfc-08a84b6a1a86 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.182887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.183776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.184089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.184363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.205540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.207846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.210119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 86/165] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:35.217242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.229999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603922c1-cc78-4d08-8066-242f4ca80205 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.238212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.239172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.239657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.240693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.251766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.254008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae389761-8b8e-4b83-b978-5c386032c402 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.266175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 80/166] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:35.272754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.284864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5912-5936-4a89-bc15-7a2bae15e538 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.285182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5912-5936-4a89-bc15-7a2bae15e538 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.285410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc5912-5936-4a89-bc15-7a2bae15e538 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.288112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 81/167] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:35.288214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f8b10-dd65-450e-a293-48b8c6177a35 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.293828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.294688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.294967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.295246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.296594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.300012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.300305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.300556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.304255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.306643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 87/168] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:35.315224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.325785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:35.327394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:35.328999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf90f-4558-4a3b-9493-bf4fd6fa9d30 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.335392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.336453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.336970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.337556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.338705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=93a09500e0284402aff7326e595b798b) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:35.339243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.340066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 82/169] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:35.345823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.354251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 88/170] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/role_assignments?user.id=93a09500e0284402aff7326e595b798b&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=e41adb3856204ccab507dffc30b49ede => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:35.370326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.380993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c435e-9c6f-47a9-86d6-96546157fa98 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.385785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.386639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.386926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.387200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.399805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:35.407002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:35.408279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 83/171] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:35.415874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.430408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29392672-6aeb-4897-8a28-b7b94b8c6463 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.440904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.441898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.442297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.442652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.444745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:35.444745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.446264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.457071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 89/172] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:35.463770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.475487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63416af-e04b-4e68-a0d1-a810de011246 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.481023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.481973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.482320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.482602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.484058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.486067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.487864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 84/173] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:35.494564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.505388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b0692-89e9-4528-a489-43e41d27e770 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.512434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.513203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.513488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.513767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.524771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.529332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.541067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 90/174] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:35.547521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.560272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a59bd4-bac8-4543-8b82-d2ae8cec3afa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.567371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.568460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.568842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.569179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.570511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.572778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d34b-5fbe-4214-9b02-a68491fdb910 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.574478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 85/175] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:35.581041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:35.591443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d6850-e0e6-45e3-961a-02819261ba44 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:35.596020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:35.596668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:35.596946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:35.597223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:35.598049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:35.598357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:35.601218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42d5d4-ebe9-40c2-a67a-3936811ab313 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:35.607472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 91/176] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:35 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:36.235513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae638c3-fe49-49bd-8e6d-947846c822f6 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.236518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae638c3-fe49-49bd-8e6d-947846c822f6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.236993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae638c3-fe49-49bd-8e6d-947846c822f6 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.239002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 86/177] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:36.244377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462ef1-73a0-478b-b056-93674d555aa2 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.244662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462ef1-73a0-478b-b056-93674d555aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.244946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a462ef1-73a0-478b-b056-93674d555aa2 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.246819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 92/178] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:36.248386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.248979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.249534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.254752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.255046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.255331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.270133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:36.271764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:36.276921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:36.278111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:36.280826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 87/179] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:36.286362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 93/180] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:36.305984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.311078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.319755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cecd8-33b2-4b4b-ba08-8afbff02ba57 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.321702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929325-cb67-4bb6-83dc-26445e9cf51b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.324890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.325880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.326332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.326617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.326983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.327405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.327690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.328095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.329355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.331695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.333682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 94/181] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:36.340712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.343285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:36.350828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:36.351221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee59d10-9bf2-41b0-a33a-4e4bb528b2c9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.352607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 88/182] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:36.358818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.359487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.360287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.360575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.360851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] PATH_INFO: `/v3/groups` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.361545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.362561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:36.362561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:36.362561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:36.363821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.371129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35241-2199-4691-b682-0fb81eaa5c67 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.375880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.376575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.376852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.377123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.377858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:36.378159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.379753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.389830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 89/183] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:36.395658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.405322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cdf96-4293-49a6-a346-435e8eadf732 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.409583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.410396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.410673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.414925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.414925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.414925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.416309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 90/184] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:36.421841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.432836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776c0f1-374c-46a4-b7c4-551dca66ea44 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.438786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.439811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.440321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.440715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 95/185] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 01:46:36 2022] POST /identity/v3/groups => generated 229 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:36.441255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.452096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.454313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.466583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 91/186] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:36.477512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.487851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea78d0-d6ea-43e6-ba26-450b53aea09d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.493287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.494163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.494446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.494717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.496063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.498204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a905a-55c0-4f24-ab85-df8eff49b0f7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.500265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 96/187] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:36.507061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:36.516675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea968e-a57d-4eb1-ae2e-4c6f081d4b41 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:36.521373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:36.522067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:36.522466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:36.522745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:36.523643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=93a09500e0284402aff7326e595b798b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:36.524051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:36.525982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3685a-da69-4ba0-b1f4-a443897ceb82 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:36.532757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 92/188] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:36 2022] GET /identity/v3/role_assignments?user.id=93a09500e0284402aff7326e595b798b&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=f64957bf427046ef80071913d3681efc => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:37.658262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422cd7-00a4-4890-9cc2-a20977433262 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.658807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422cd7-00a4-4890-9cc2-a20977433262 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.658807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85422cd7-00a4-4890-9cc2-a20977433262 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.660595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 97/189] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:37.669257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.669856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.669856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.688476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:37.689733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:37.698305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 93/190] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:37.721739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422cd7-00a4-4890-9cc2-a20977433262 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.734952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85422cd7-00a4-4890-9cc2-a20977433262 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.739646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.741078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.741338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.741614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.754047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:37.761625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:37.762897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 98/191] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:37.769617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.779180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba751920-e50b-4957-a078-6ed9fbba820a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.783840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.784543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.784821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.785093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.785847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:37.786148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:37.787783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:37.796776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 94/192] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:37.803656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.814455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2fa57-6bc3-47fc-a08e-80f0b96b768c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.819521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.820452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.820727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.821047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.822244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:37.824432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0b0bf-ab9e-4a8f-b394-35dedecfcee8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:37.826029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 99/193] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:37.832343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.842658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d780-3498-44ec-945e-c9b74dacab13 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.846627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbd9cc-8fc8-472e-9a08-ae5f1d64a4e9 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.846912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbd9cc-8fc8-472e-9a08-ae5f1d64a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.847192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbd9cc-8fc8-472e-9a08-ae5f1d64a4e9 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.847439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.848402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.848749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.848988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 100/194] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:37.849199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.850825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:37.853256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:37.855059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 95/195] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:37.856887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.857230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.857567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.861075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.874020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236629d-fa60-4865-b7c8-e6444987ce43 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.877262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:37.878470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:37.878715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.879696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.880084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.881242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962/users/93a09500e0284402aff7326e595b798b/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.883397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef05a605ed274fbe91300e06be587962, user_id=93a09500e0284402aff7326e595b798b, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:37.886296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:37.887385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 101/196] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:37.915181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.920226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a52e6-bf67-45aa-9867-8ac24a89c566 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:37.924731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:37.925896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:37.926347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:37.926887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:37.938687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:37.946384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:37.947889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 102/197] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:37.954484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:37.969827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 96/198] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:37 2022] PUT /identity/v3/projects/ef05a605ed274fbe91300e06be587962/users/93a09500e0284402aff7326e595b798b/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:46:37.970860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625850c-199c-435a-a5e3-add1c9f79bb1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.047864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.049005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.049502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.050045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.050997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:38.051495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.054282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.064901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 103/199] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:38.076110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.086699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32c9bd-b862-4d26-8050-e22024581171 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.091942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.092874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.093211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.093486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.094747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.096849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.098929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 97/200] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:38 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:38.106068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.118157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994f8a9-a6b9-4b2c-9036-c30dedd4551e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.123071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.124008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.124299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.124626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.125942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.128212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8c07-3da1-489e-bfbf-af81f9476fa6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.133712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 104/201] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:38 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:38.145250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.157070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a23b-bce2-481c-bdb8-e92b4c61d0fd admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.162229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.163147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.163435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.163718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.165821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef05a605ed274fbe91300e06be587962, user_id=3562fb362d174fe499304c112522dca6, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.168482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc281001-f21f-4c74-a400-8ce6147db950 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.284386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 98/202] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:38 2022] PUT /identity/v3/projects/ef05a605ed274fbe91300e06be587962/users/3562fb362d174fe499304c112522dca6/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:46:38.795547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecc3-6467-4a08-9069-bec2709c4797 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.796106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecc3-6467-4a08-9069-bec2709c4797 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.796106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247ecc3-6467-4a08-9069-bec2709c4797 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.797893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 105/203] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:38.806290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.806758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.806856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.824806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:38.825995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:38.828586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb190d-07c6-4133-b989-a6cf1b8e2c02 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.828872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb190d-07c6-4133-b989-a6cf1b8e2c02 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.829158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb190d-07c6-4133-b989-a6cf1b8e2c02 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.830922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 106/204] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:38.839448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.840024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.840287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.858908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:38.860123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:38.897802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 99/205] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:38.922145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.929142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 107/206] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:38.934405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a3cc9-3fac-4132-8ed9-6c807acd6641 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.938908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.939706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.940013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.940298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.951194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:38.954138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.958994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:38.960295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 100/207] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:38.963873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cc7ce-b117-42c9-9e05-2d9cd8710e76 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.967374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.968923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.969821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.970101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.970372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.971548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.973358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.975634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 108/208] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:38.978155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804f3-e36e-4635-9982-d8d90c7e03f2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.982011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:38.984525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.985193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.985475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.985756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:38.986516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:38.986884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:38.988593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:38.993342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119fc66-6888-4af1-a9c3-342ee83b7a2a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:38.998222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:38.998958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:38.999237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:38.999489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 101/209] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:38.999600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] PATH_INFO: `/v3/groups` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:39.000265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:39.002232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c720020-d6e7-4e42-a921-b3285817cdc0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:39.005693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:39.015378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5d5a8-d7cf-48cd-ad9a-c1c8a01f6ba5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:39.019846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:39.020822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:39.021153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:39.023913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:39.023913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:39.025084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:39.026962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 102/210] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:39 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:39.032763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:39.043299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13427877-1530-44b8-bdf8-4ef071cfdc43 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:39.047858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:39.049176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:39.049176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:39.049340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:39.050473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:39.053120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:39.054841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 103/211] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:39 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:39.061033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:39.071467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18181edf-3956-4660-826f-5e8c1f396903 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:39.075887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:39.076786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:39.077066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:39.077338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962/users/93a09500e0284402aff7326e595b798b/roles/f64957bf427046ef80071913d3681efc` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:39.079575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef05a605ed274fbe91300e06be587962, user_id=93a09500e0284402aff7326e595b798b, role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:39.082187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a58c1d-81f0-44c8-9909-7a0298e4d037 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:39.136003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 109/212] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 01:46:38 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:39.164968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 104/213] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:46:39 2022] PUT /identity/v3/projects/ef05a605ed274fbe91300e06be587962/users/93a09500e0284402aff7326e595b798b/roles/f64957bf427046ef80071913d3681efc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:46:40.331595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403dae-7f6e-482e-9ad8-f151c37f170b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.332145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403dae-7f6e-482e-9ad8-f151c37f170b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.332220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f403dae-7f6e-482e-9ad8-f151c37f170b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.334327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 110/214] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:40.343511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.344035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.344112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.373996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:40.376179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:40.475668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 105/215] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:40.499735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f403dae-7f6e-482e-9ad8-f151c37f170b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.518642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f403dae-7f6e-482e-9ad8-f151c37f170b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.526039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.527401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.527911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.528445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.544396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:40.551277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:40.553366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 111/216] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:40.560104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.569827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e48315-3519-4858-8b8a-50fd1adb0b8e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.574491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.575172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.575456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.575736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.576547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:40.576859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.578468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.592331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 106/217] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.598678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.610785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657ca3-e186-4c84-b7eb-f2e3f0f4a629 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.615871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.616821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.617106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.617387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.618828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.621116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.628418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 112/218] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.629873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.640451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afa27d-92a4-49ca-a59b-cdb1753e7b03 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.645297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.646543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.646831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.647112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.656692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.658519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.669218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 107/219] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:40.676036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.686514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7328e9-0b70-4720-bff3-409e3f433003 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.691458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.692592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.692951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.693231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.694748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.696919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aea08-9650-4960-bd22-f8f15d1e249c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.698731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 113/220] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.705718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.716515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f52a1-79ba-408c-a263-d380d22903bc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.721608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.722265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.722555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.722875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.723725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] RBAC: Adding query filter params (role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=93a09500e0284402aff7326e595b798b) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:40.724803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.727598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601f49f-72f4-4c87-99b2-96821290465c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.735602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 108/221] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/role_assignments?user.id=93a09500e0284402aff7326e595b798b&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=e41adb3856204ccab507dffc30b49ede => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.743111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2ab0-5301-41c8-815e-4e748a1f7ace None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.743529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2ab0-5301-41c8-815e-4e748a1f7ace None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.743855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe2ab0-5301-41c8-815e-4e748a1f7ace None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.746594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 114/222] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:40.755140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.755451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.755732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.785830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:40.787632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:40.800703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 109/223] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:40.845048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe2ab0-5301-41c8-815e-4e748a1f7ace None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.862713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe2ab0-5301-41c8-815e-4e748a1f7ace None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.872860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.873687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.873971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.874248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.887636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:40.894666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:40.896887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 115/224] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:40.903310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.915161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc42dd-66ab-4c07-be18-7ee2d79144ed None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.921660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.922353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.922638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.922921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.923698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:40.924032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.925674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.940946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 110/225] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.948600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.962492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c6ca-d949-4a3e-bc00-5e7fab5a81a7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.970608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.971499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.971780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:40.972085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:40.973372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:40.975493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:40.978406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 116/226] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:40.983508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:40.993998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c65-66da-43ed-bbd8-85a9cf4e8bf2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:40.998899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:40.999574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:40.999856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:41.000178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:41.014571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:41.016388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:41.029627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 111/227] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:40 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:41.036899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:41.054207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23abf-35e7-40fc-8d56-5a4af527b8ed admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:41.062088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:41.062946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:41.063229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:41.063501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:41.064739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:41.066983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3966b-c95a-4ffe-a215-1665fc52d11b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:41.069446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 117/228] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:41 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:41.076601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:41.086618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988c763-2cfd-41b6-bc7b-5dacb5afbea3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:41.096281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:41.096951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:41.097232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:41.097519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:41.098366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=3562fb362d174fe499304c112522dca6) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:41.098681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:41.100890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05482e01-c75d-45bf-b540-3e859b978b7d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:41.112708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 112/229] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:41 2022] GET /identity/v3/role_assignments?user.id=3562fb362d174fe499304c112522dca6&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:42.033957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4119-52e4-4174-ac7a-0e029133dfaf None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.034727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4119-52e4-4174-ac7a-0e029133dfaf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.034727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4119-52e4-4174-ac7a-0e029133dfaf None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.037023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 118/230] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:42.047550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.048529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.049007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.072690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:42.074225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:42.087680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 113/231] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:42.115284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0642-f01c-408f-9585-ed3ce255d323 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.115896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0642-f01c-408f-9585-ed3ce255d323 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.116419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c0642-f01c-408f-9585-ed3ce255d323 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.118415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 119/232] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:42.126286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.126887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.127379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.129919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.155924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69b830-29ee-4b3a-893b-ca037d48d3f9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.162137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:42.168403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:42.170320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.171445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.171933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.172432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.190308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 120/233] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:42.200992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:42.209057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:42.210632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 114/234] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:42.217406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.226645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.233923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd43e9-2968-4e5d-91bd-cec80efebf29 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.244859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.246001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.246490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.246964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.247926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:42.248459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.250321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.252728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93edde2-c49e-410a-a226-c95e6fa4a62f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.262162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.263252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.263606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 121/235] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:42.264096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.264381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.270127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.287678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:42.289216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946bf3e-77ac-44cd-8a64-6fc6410039f5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.295151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:42.296920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 115/236] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:42.298665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.299572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.300195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.300676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.304292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.314276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.316439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.322469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646631-9175-434e-8119-6d268b921a9b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.330552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 122/237] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:42.331472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.332777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.333980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.334621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.335742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:42.336331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.338072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.338486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.348604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 116/238] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:42.354856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649b77-6d92-409d-8459-167215f683e9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.357394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.366755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.367783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.368215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.368527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.371167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbfe1e-6b63-422e-b4fb-f9804ecdb799 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.372111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.374639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.376547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.376833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 123/239] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:42.377862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.378280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.378852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.381084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.382906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.383869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.385970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 117/240] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:42.393729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.399179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8127-f33e-4787-9f1f-712ad290fba0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.406395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f796ea-d83f-446d-a174-ed17dc0296e6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.409600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.410714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.411078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.412117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.414378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.415695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.416290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.416737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.425621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.426772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:42.426772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:42.426772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:42.427904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.428430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.430237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.430362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 124/241] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:42.437611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.444149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 118/242] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:42.455432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.458866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbef44-b750-476e-80c8-6bbee09d1489 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.471126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125e00-4be1-48f5-9e94-c21e146664c3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.474503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.475106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.475544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.475995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.477397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:42.477966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.478569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.479787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.480043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.480667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.481312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.483912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.488251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe7c6a-19b7-43ba-94a5-90abb2dc5cea admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.493035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 125/243] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=e41adb3856204ccab507dffc30b49ede => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:42.493652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 119/244] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:42.504869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:42.523627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d36f-4e86-44a4-a665-70a95ddadb9d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:42.529946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:42.531201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:42.531908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:42.532386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:42.533507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=ef05a605ed274fbe91300e06be587962, user.id=93a09500e0284402aff7326e595b798b) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:42.534059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:42.536774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debab61-6063-4c68-8d90-efeb85413d37 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:42.547419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 126/245] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:46:42 2022] GET /identity/v3/role_assignments?user.id=93a09500e0284402aff7326e595b798b&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=f64957bf427046ef80071913d3681efc => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:43.731303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2fd5-aeeb-4a3e-a52b-7736d2022bf7 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.732403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2fd5-aeeb-4a3e-a52b-7736d2022bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.732906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2fd5-aeeb-4a3e-a52b-7736d2022bf7 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.734880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 120/246] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:43.737968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fdd3-53ae-4d84-a6ef-b529f8c90666 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.738836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fdd3-53ae-4d84-a6ef-b529f8c90666 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.739308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fdd3-53ae-4d84-a6ef-b529f8c90666 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.741750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 127/247] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:43.746710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.747264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.747760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.761220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.766849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.767392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.781859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:43.789460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:43.796762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:43.798311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:43.804992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 121/248] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:43.808337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 128/249] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:43.834224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:43.845589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:43.848517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285778e0-574d-4c8b-9a1f-017be1022f63 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:43.857013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58f4f3-3e8d-475b-8c38-a60c84ac4617 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:43.861939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:43.862176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:43.862984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.863315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.866119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.866467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.867022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.867544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.884125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:43.892511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:43.900919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:43.903036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 129/250] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:43.908023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:43.908023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 122/251] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:43.917762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:43.928506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c8372-e2b7-4a2f-948f-6c6efaa2b0c8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:43.932425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:43.935720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:43.936855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.937345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.937818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.938787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:43.939292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:43.941171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:43.949287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63a32-4995-43ce-992b-492d767c70b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:43.955799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 130/252] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:43.963178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:43.965254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:43.965934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.966218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.966497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.967264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:43.967574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:43.969256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:43.976416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac2009-1be8-4619-90f8-a481dcd138f8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:43.981594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:43.982580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:43.983073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:43.983559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:43.987648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 123/253] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:43.998206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.000391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.011178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 131/254] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:43 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:44.014359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.019171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.029439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049958-65ea-47fe-93a5-80a352832f30 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.034664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.036668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.037499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.038302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.038687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cc2f9-7e0b-4253-a911-94bf528592e3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.041364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.045796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.049945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 132/255] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:44.057646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.060702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.061635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.062124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.062619 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.075198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f60723-1cda-41a7-8510-9d029d6629dd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.081227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.081872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.083821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.084459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.085067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.085659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.087185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.089827 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.092075 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 133/256] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:44.099393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.101697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 124/257] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:44.111336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2ca5-7c3d-4963-9373-a1a9aa324b84 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.121767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.123429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.124225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.125047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.126920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=f64957bf427046ef80071913d3681efc, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:44.127755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.132387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.140314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.147680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 134/258] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=f64957bf427046ef80071913d3681efc => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.168957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1970c-9f63-424a-8f1c-7d2f7ea8b6b9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.182544 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.183425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.183709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.184009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.189044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.192267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.195135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 125/259] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.202276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.215838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27266-cb2a-4367-99a6-6c2052e019b5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.225954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.227220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.227779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.228281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.229993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.232259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e88cf-e9cd-4560-b3d4-adae78a4a7ac admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.234208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 135/260] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.242751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.256575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc2da-46f9-4d11-aa4b-6769b8f8f2d0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.267468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.268895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.269547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.270021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.271886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=ef05a605ed274fbe91300e06be587962) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:44.272528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.274704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b381fb-877e-41f6-b6e4-4af1303b79a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.281998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 126/261] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=e41adb3856204ccab507dffc30b49ede => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.617901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9fd0a-aaf7-471d-a251-1e8767b8f811 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.618687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9fd0a-aaf7-471d-a251-1e8767b8f811 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.619385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9fd0a-aaf7-471d-a251-1e8767b8f811 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.621778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 136/262] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:44.634870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.635565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.636180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.665228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:44.667016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:44.676730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 127/263] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:44.704750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9fd0a-aaf7-471d-a251-1e8767b8f811 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.718519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9fd0a-aaf7-471d-a251-1e8767b8f811 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.723140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.726211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.726637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.726968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.740140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:44.747471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:44.749063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 137/264] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:44.755911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.770322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ab684-20bd-48c1-87d2-6e3de2ffafa0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.781266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.782330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.782616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.782954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.784270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:44.784620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.787064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.806061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 128/265] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:44.812875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.825656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c98d-ed9a-4d99-98ad-7d740d88797c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.837410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.838502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.839070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.839816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.853780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.856002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.871809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 138/266] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:44.878474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.896682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a33bd-d138-4b98-9cff-bcfcbf4d93c9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.910260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.911765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.912099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.912403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.916825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.918964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.920972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 129/267] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.928335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.944000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbc1-1187-432b-a06b-3f8bd6823b9a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.949525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.950816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.951357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.951848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.953386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:44.955709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c3ede-f149-462b-8437-76e886025c57 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:44.958862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 139/268] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:44.966348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:44.981204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3c2f-d23f-43a6-9bc9-76c27c70ed4d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:44.996728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:44.997398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:44.997684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:44.997961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:44.998816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=f64957bf427046ef80071913d3681efc, scope.project.id=ef05a605ed274fbe91300e06be587962) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:44.999124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:45.001013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3e4c2-4c91-4239-b62b-de2540199576 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:45.007866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 130/269] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:44 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=f64957bf427046ef80071913d3681efc => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:45.617753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174568-eeac-4bce-8e42-57189de0ed2a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.618442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174568-eeac-4bce-8e42-57189de0ed2a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.618958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174568-eeac-4bce-8e42-57189de0ed2a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.621358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 140/270] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:45.630731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.631493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.632050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.658057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:45.659767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:45.674455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 131/271] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:45.717426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2174568-eeac-4bce-8e42-57189de0ed2a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.736446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2174568-eeac-4bce-8e42-57189de0ed2a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:45.746216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:45.747850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.748362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.748849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.764180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:45.778138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-22faf627-ec55-43ec-9a63-7ad1d9ac4f9c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:45.780450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 141/272] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:45.788864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.797163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa93f6-8248-45e6-bf8e-0f95d823ee12 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.797880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa93f6-8248-45e6-bf8e-0f95d823ee12 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.798388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa93f6-8248-45e6-bf8e-0f95d823ee12 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.800833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 142/273] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:45.806868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272db7d-1dac-45e6-8e76-e312fcaea7f5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:45.812280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.813279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.813972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.818536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:45.820942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.823206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.823777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.825484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:45.826971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:45.829971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:45.852625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:45.853844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:45.860593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 132/274] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:45.871999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 143/275] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:45.873768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.894841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f515777-f350-4793-98e4-824ce505d084 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:45.907707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:45.908392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.908676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.908955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.922637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:45.924471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:45.934665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.937934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 133/276] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:45.945278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.953698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf8585-142c-41e5-85f7-99758eb0ec99 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:45.957533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b99874-60df-413f-87b4-ec267e703981 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:45.966749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:45.967243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:45.968171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.968607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.968714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:45.969020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.969123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:45.969534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:45.970847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ed384f6c4594ad68721f19ac9473b0e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:45.974592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:45.980104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 134/277] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:45.987498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:45.992764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:45.999038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1adfa-6d92-42ba-8b55-974c43e9c4d5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.004784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:46.005090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.006559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.006770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 144/278] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:46.012134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.012514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] PATH_INFO: `/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.014504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:46.019716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] RBAC: Authorizing `identity:get_group(group_id=6ac2b84338c14da9ab4c8ea2df724b4b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.021720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:46.021720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:46.021720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:46.022972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.025304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 135/279] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:45 2022] GET /identity/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:46.026270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c165b2a-1b9c-49cc-b801-973636abc6d6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.033986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:46.036754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.037734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.038024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.038304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.039076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:46.039386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.049325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.053419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8736a-c632-4449-9b49-7bc1f5602903 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.060745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.061088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 145/280] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:46.068973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.069273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.069522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.070783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] RBAC: Adding query filter params (group.id=6ac2b84338c14da9ab4c8ea2df724b4b, role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=9ed384f6c4594ad68721f19ac9473b0e) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:46.071165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.073952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.080595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:46.083640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 136/281] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:46 2022] GET /identity/v3/role_assignments?group.id=6ac2b84338c14da9ab4c8ea2df724b4b&scope.project.id=9ed384f6c4594ad68721f19ac9473b0e&role.id=696ce32a0d804992a93645d6906b0119 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:46.095818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e8b9-2e56-4f68-adda-1a663ab8caab admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.108665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.109688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.110016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.110470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.112688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.115491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.119088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 146/282] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:46 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:46.126013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:46.146893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844e1f-d310-4ec8-b91e-8c677008a1ad admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.156296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.157344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.157751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.158063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.160726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.163718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f527a7e-bfdd-46da-95d8-1d21dcbd2096 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.168126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 137/283] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:46 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:46.177523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:46.193490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408af54-7ba3-4784-9a6d-f30ec82fd1af admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:46.199328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:46.200409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:46.200695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:46.200973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:46.203135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33926690fbc24a2d8d30cdff9ed944f5, group_id=e4e1f3a7946642e5b99c6e6d34d921d0, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:46.205892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8abd73-057f-4bbd-82e8-b37910c42f7a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:46.298987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 147/284] 10.222.0.79 () {58 vars in 1463 bytes} [Fri Jan 28 01:46:46 2022] PUT /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:47.668684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3a34-b9a0-4a64-97f9-b254246101cd None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:47.669380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3a34-b9a0-4a64-97f9-b254246101cd None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:47.669380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3a34-b9a0-4a64-97f9-b254246101cd None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:47.671254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 138/285] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:47.686986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:47.687625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:47.687625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:47.709661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:47.710922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:47.811079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5585-1bc0-4952-92a2-09967d94085c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:47.811517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5585-1bc0-4952-92a2-09967d94085c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:47.811953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf5585-1bc0-4952-92a2-09967d94085c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:47.815576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 139/286] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:47.836489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:47.836945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:47.837481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:47.884064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:47.885513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:47.922760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 148/287] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:47.973189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:47.994592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0d1b-24a4-434d-a928-1861610aeadf None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:47.999485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.000321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.000603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.000875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.008887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 140/288] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:48.013363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:48.022226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:48.022998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 149/289] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:48.029214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.042072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4045-75fa-4e28-b850-2a935216c269 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.046627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.047293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.047576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.047852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.048723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:48.049022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.051262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.058417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.068255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322699c-d107-4537-82e0-4ee7bdb290e4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.074157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.074958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.077423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 141/290] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.077617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.077812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.091229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.106384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef63988-f752-49b5-be1b-a22f6d0fc49d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.110219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:48.117449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.119559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.119845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.120148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.121474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.123216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:48.123507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.125393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 142/291] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:48.127947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 150/292] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:48.142136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.151477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.153994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1cb3d-35d0-4ed5-9204-72c63d89ea1a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.158790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.159897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.160298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.160579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.162722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.164941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.165923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a921-f957-4ee5-a6d2-8d998ef1b0c1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.167042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 143/293] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.172202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.173359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.178320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.178574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.178857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.180714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:48.181587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.184911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.191163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f734-7cd1-4ecb-9efc-f920b80a981e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.200995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.202112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.202395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.204928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.205550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 151/294] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:48.207042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef05a605ed274fbe91300e06be587962, group_id=e4e1f3a7946642e5b99c6e6d34d921d0, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.210684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd86fd-3777-468b-9458-2c57de7e3589 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.211859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.225991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2279de-4183-41d9-939a-4fec86264c20 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.230873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.232206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.232206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.232584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.233648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.235688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.240288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 152/295] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.248966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.262917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c2e8-9d25-42ca-80fb-de3895018437 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.268595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.269568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.269854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.270128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.272432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.274779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.283941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 153/296] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.283941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.297707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2cc2c-cf56-4564-9e04-126201b2172f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.304079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.305125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.305443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.305714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/f64957bf427046ef80071913d3681efc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.308294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33926690fbc24a2d8d30cdff9ed944f5, group_id=e4e1f3a7946642e5b99c6e6d34d921d0, role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.311859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.323144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 144/297] 10.222.0.79 () {58 vars in 1463 bytes} [Fri Jan 28 01:46:48 2022] PUT /identity/v3/projects/ef05a605ed274fbe91300e06be587962/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:48.364419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33c8c-a40f-4c37-abb7-37aa75d7b7ac None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.364798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33c8c-a40f-4c37-abb7-37aa75d7b7ac None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.364966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33c8c-a40f-4c37-abb7-37aa75d7b7ac None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.367209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 145/298] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:48.374917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.375311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.375664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.401606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:48.403266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:48.419798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 154/299] 10.222.0.79 () {58 vars in 1463 bytes} [Fri Jan 28 01:46:48 2022] PUT /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/f64957bf427046ef80071913d3681efc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:48.485086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 146/300] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:48.512705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.601236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffd36-3e4d-457d-aaca-e0d3f07c7903 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.605813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.606633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.606917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.607191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.621249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:48.630665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:48.632335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 155/301] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:48.638653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.652333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d24dd-eace-4541-90f5-f3da5a741f7b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.658848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.659858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.660406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.660899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.662344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:48.662907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.664804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.674898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 147/302] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.681919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.694854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c60329-b854-485c-9d8a-814abc7c68e1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.700706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.701567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.701845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.702116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.705555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.707508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.709385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 156/303] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:48.718248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.733790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ab2a-4523-467b-b377-862e7d27176c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.738695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.740112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.740753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.741159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.742487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.744716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7daaf4-556d-424c-8c37-cca35f18b9dd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.746825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 148/304] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:48 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:48.752806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:48.770147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebc885-96a3-473f-9c44-8d84fee1de22 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:48.780637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:48.781755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:48.782189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:48.782605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/f64957bf427046ef80071913d3681efc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:48.785079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef05a605ed274fbe91300e06be587962, group_id=e4e1f3a7946642e5b99c6e6d34d921d0, role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:48.788289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbff396-3686-4290-9b41-8d98148ee6e3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:48.889002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 157/305] 10.222.0.79 () {58 vars in 1463 bytes} [Fri Jan 28 01:46:48 2022] PUT /identity/v3/projects/ef05a605ed274fbe91300e06be587962/groups/e4e1f3a7946642e5b99c6e6d34d921d0/roles/f64957bf427046ef80071913d3681efc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:46:49.458981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f744-30a8-4dfd-9448-166e1b2fc424 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.459385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f744-30a8-4dfd-9448-166e1b2fc424 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.459557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2f744-30a8-4dfd-9448-166e1b2fc424 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.460302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083168-3374-4fe2-8871-28489cb3abb0 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.460596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083168-3374-4fe2-8871-28489cb3abb0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.460879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083168-3374-4fe2-8871-28489cb3abb0 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.461692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 149/306] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:49.462956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 158/307] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:49.469352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.469878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.470168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.471844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.472339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.472623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.498417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:49.499623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:49.501105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:49.502301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:49.580479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 150/308] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:49.602815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 159/309] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:49.605684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.615434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ef12-6b6b-4b67-9de7-ced3710cf69a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.628250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.629411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.629810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.630090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.643471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:49.653557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:49.655078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 151/310] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:49.662386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.672171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6f344-43b0-4666-be79-62fec172477f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.677680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.685142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.685823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.686104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.686390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.687394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:49.687699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.689199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ed254-d761-439c-be02-a9f4901f06d9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.689373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.694132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.695155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.695628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.696141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.704969 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 160/311] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.711507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.714693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:49.722032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeebcc-a2af-42a3-964a-18209b1e42ac admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.722805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:49.734943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 152/312] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:49.736955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.744366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.745256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.745750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.746212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.757384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff75c-1e41-4b3f-9d0b-f2c55d08dab4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.758404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.761133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.770051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.771677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.772360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.772843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.773783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:49.775376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.777210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.782918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 161/313] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:49.796242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.796404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 153/314] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.797573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b69d-9748-4f3a-9455-0b5c6322f938 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.804010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.812555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.813673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.814144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.814623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.816306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.820028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.825692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c178-a503-4ee5-8599-c68d801029e5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.825947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 162/315] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.829414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.837739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.838876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.839626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.840119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] PATH_INFO: `/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.841494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] RBAC: Authorizing `identity:get_group(group_id=6ac2b84338c14da9ab4c8ea2df724b4b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.843590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.850448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164cfb-37fa-488e-910b-10318ae107c7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.850790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 154/316] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.853914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.861910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.863015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.863488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.863950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.866063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.869196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.872024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 163/317] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.878813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.880278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe12bac-1214-4155-86ec-610193841745 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.884992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.886070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.886554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.887017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.888426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] RBAC: Authorizing `identity:get_project(project_id=9ed384f6c4594ad68721f19ac9473b0e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.890577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.898045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 155/318] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.899676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d487-69d3-480e-92ee-bdad2a203301 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.900711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:49.909834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.910826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.912494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.913000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.914552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:49.916134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.918404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061be46-41da-40ad-bd30-a5275a4da20d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:49.920796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784570-70ea-4cbc-bb4e-29f77b849d7c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:49.930000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:49.932304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 164/319] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:49 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=e41adb3856204ccab507dffc30b49ede => generated 611 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:49.933630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:49.934138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:49.934605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e/groups/6ac2b84338c14da9ab4c8ea2df724b4b/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:49.937086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed384f6c4594ad68721f19ac9473b0e, group_id=6ac2b84338c14da9ab4c8ea2df724b4b, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:49.940255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae03913-b767-43ab-92f0-5712f4e2878f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:50.041322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 156/320] 10.222.0.79 () {58 vars in 1463 bytes} [Fri Jan 28 01:46:49 2022] PUT /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e/groups/6ac2b84338c14da9ab4c8ea2df724b4b/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:46:51.114967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6395-2040-4308-9034-07075c9d787f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.115956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6395-2040-4308-9034-07075c9d787f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.116259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6395-2040-4308-9034-07075c9d787f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.118462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 165/321] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:51.133141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.133656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ef97-765b-4599-806b-aa5eb4758250 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.133857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ef97-765b-4599-806b-aa5eb4758250 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.134141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23ef97-765b-4599-806b-aa5eb4758250 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.134516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.135111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.136240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 166/322] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:51.147377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.147377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.147377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.170336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:51.171610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:51.172973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:51.175386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:51.260407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 157/323] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:51.282476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 167/324] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:51.297443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.308050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.310159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4c63-9577-41b3-9ba5-c86595333ac7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.315841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.316986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.318523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.319061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.326048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa671fc4-82ae-40d9-a567-3a8fc827b4c2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.330615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.332006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.332478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.332940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.336918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:51.345377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:51.345646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:51.347462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 158/325] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:51.356535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:46:51.356535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 168/326] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:51.358405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.361240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.372182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818874c2-de63-4ed2-aa42-5114f68bcfcd admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.372549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cf214-db47-4a86-804d-29f6e9093164 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.376855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.377610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.377889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.378162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.378519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.378913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.379215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.380550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.381046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.381527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.381698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.382663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.383182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.385048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.400791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 159/327] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.401349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 169/328] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.401559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.402733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.414023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18bd5-052d-40d5-bb9c-d0a8cc316b6c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.415231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32b6db-729c-4afa-be79-4c68986c6af3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.419565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.420541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.421129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.421606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.421802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.423193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.423642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.424131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.432413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.435324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.436038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.437921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.447618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 170/329] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:51.452924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 160/330] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:51.454676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.456417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.465233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b678b-6b76-4744-a045-4bad31eca15d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.468927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53949119-f4d8-4d6f-a3cc-45a608c7e334 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.469741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.470590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.470865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.471135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.472792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.475713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.476193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.477357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.477575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 161/331] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.478063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.478548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.480869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.483376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.483839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.486226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 171/332] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:51.496705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.497481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49186a29-8ff9-413e-a324-6a52b12fb2c2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.502351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.503430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.503712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.504001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.505524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.507607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.511141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35946d6-1fed-4268-bc60-5846f65a7a95 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.515177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 162/333] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.516843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.517899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.519137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.519664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.520204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.522268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.524875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.527284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 172/334] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.532137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767c11-c0ab-46fa-9208-935c93b88296 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.534427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.537846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.538599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.538879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.539154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.540080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=e41adb3856204ccab507dffc30b49ede, scope.project.id=ef05a605ed274fbe91300e06be587962) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.540392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.542427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2031f-7306-4fd5-bfef-473488322db2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.547443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c4b2-1f72-473c-932e-582397ad84e9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.553020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.554096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.554634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.555160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.556206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 163/335] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=e41adb3856204ccab507dffc30b49ede => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.556597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=f64957bf427046ef80071913d3681efc, scope.project.id=33926690fbc24a2d8d30cdff9ed944f5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.557127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.559533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c644e3-92c9-43ac-a108-8d0b8e367188 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.567580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 173/336] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=33926690fbc24a2d8d30cdff9ed944f5&role.id=f64957bf427046ef80071913d3681efc => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:51.666562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e88d4-79a5-4ef5-a6c5-0e7538720879 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.666933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e88d4-79a5-4ef5-a6c5-0e7538720879 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.667120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e88d4-79a5-4ef5-a6c5-0e7538720879 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.669426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 164/337] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:51.678249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.678872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.679376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.699556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:51.701232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:51.709917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 174/338] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:51.736535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e88d4-79a5-4ef5-a6c5-0e7538720879 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.750188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e88d4-79a5-4ef5-a6c5-0e7538720879 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.756452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.757277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.757558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.757832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.769807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:51.778056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:51.779624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 165/339] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:51.786587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.797738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af986079-7e76-41dc-b9ca-3939dfef5a60 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.802907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.803619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.803908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.804313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.805074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.805388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.806995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.816095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 175/340] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:51.822764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.834019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef518b-5dca-439f-bcf5-9a95d8d25bfc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.840277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.841106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.841526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.841951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.851598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.853560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.864052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 166/341] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:46:51.870664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.881776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4a8f2-b480-4a7d-a676-e76773c8d0ac admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.889430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.890292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.890565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.890835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.892031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.894063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.896377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 176/342] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:51.902605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.916152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13be81-0ce3-4fbf-be19-cc2ea69a8b41 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.923484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.924309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.924591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.924863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] PATH_INFO: `/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.926066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] RBAC: Authorizing `identity:get_group(group_id=e4e1f3a7946642e5b99c6e6d34d921d0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.928523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd8810-cc93-4d39-9dd2-70521b267571 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.930495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 167/343] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/groups/e4e1f3a7946642e5b99c6e6d34d921d0 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:51.936945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:51.947780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51aa1ee-6487-4576-a8ce-e8b6c8c47aea admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:51.952933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:51.953745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:51.954038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:51.954310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:51.955144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] RBAC: Adding query filter params (group.id=e4e1f3a7946642e5b99c6e6d34d921d0, role.id=f64957bf427046ef80071913d3681efc, scope.project.id=ef05a605ed274fbe91300e06be587962) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:51.955459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:51.957437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4969d-5a04-416c-9716-28f7e2c96bc8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:51.965573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 177/344] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:51 2022] GET /identity/v3/role_assignments?group.id=e4e1f3a7946642e5b99c6e6d34d921d0&scope.project.id=ef05a605ed274fbe91300e06be587962&role.id=f64957bf427046ef80071913d3681efc => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:52.583253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf756a3-417b-4f0a-8a96-a637b5fc4080 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.583817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf756a3-417b-4f0a-8a96-a637b5fc4080 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.583817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf756a3-417b-4f0a-8a96-a637b5fc4080 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.585881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 168/345] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:52.593844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.594288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.594407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.612524 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:52.613718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:52.621909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 178/346] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:52.646959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf756a3-417b-4f0a-8a96-a637b5fc4080 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.659138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf756a3-417b-4f0a-8a96-a637b5fc4080 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.663896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.664687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.664969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.665243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.675166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:52.682438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:46:52.683590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 169/347] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:52.690023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.700088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ca7f0-ca29-4cc5-814b-f4fd1ec78939 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.704677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.705327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.705613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.705891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.706633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:52.706942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:52.709046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:52.717726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 179/348] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:52.724195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.734166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdc0fb-d63c-4283-94d7-3c81f954bf4e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.738722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.739833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.740308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.740594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.749179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:52.750931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:52.760911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 170/349] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:52.767728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.778567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3c983-7cca-4990-92b7-79ce158cefc9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.783070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.783915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.784243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.784519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.785701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] RBAC: Authorizing `identity:get_project(project_id=9ed384f6c4594ad68721f19ac9473b0e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:52.787483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:52.789189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 180/350] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:52.795285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.804696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fa451-ad19-4bf0-8a87-47dd496b56c6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.809151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.809977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.810261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.810541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] PATH_INFO: `/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.811706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] RBAC: Authorizing `identity:get_group(group_id=6ac2b84338c14da9ab4c8ea2df724b4b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:52.813617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d8598-7484-484a-aa50-668f92ed8f19 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:52.815183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 171/351] 10.222.0.79 () {56 vars in 1201 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/groups/6ac2b84338c14da9ab4c8ea2df724b4b => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:46:52.822082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:52.831634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799c36b-f37f-4ec6-bff5-6f1ac4ae626d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:52.836366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:52.836943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:52.837225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:52.837494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:52.838312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] RBAC: Adding query filter params (group.id=6ac2b84338c14da9ab4c8ea2df724b4b, role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=9ed384f6c4594ad68721f19ac9473b0e) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:52.838623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:52.840727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b311df-1387-4824-ad3d-25b8db4ba3e9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:52.846481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 181/352] 10.222.0.79 () {56 vars in 1397 bytes} [Fri Jan 28 01:46:52 2022] GET /identity/v3/role_assignments?group.id=6ac2b84338c14da9ab4c8ea2df724b4b&scope.project.id=9ed384f6c4594ad68721f19ac9473b0e&role.id=696ce32a0d804992a93645d6906b0119 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:56.235621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66f79-ac4e-4953-bd9e-76394b116cc3 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.237430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66f79-ac4e-4953-bd9e-76394b116cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.238197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e66f79-ac4e-4953-bd9e-76394b116cc3 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.242336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 172/353] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:56.251101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.252526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.253703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.290937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:56.292530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:56.304165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 182/354] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:56.312908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487a5-a9fe-4aba-a585-84b6a9ea7205 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.313455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487a5-a9fe-4aba-a585-84b6a9ea7205 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.313954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487a5-a9fe-4aba-a585-84b6a9ea7205 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.316231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 173/355] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:56.331587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.332215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.333199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.333942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.356909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825cb07-7864-4839-b932-11a9f2c700c2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.367809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:56.370826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:56.371738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.372829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.373331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.373797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.393374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 174/356] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 01:46:56.394558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.397613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.416434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:56.417982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 183/357] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:56.424510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.433141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.437074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86e20-33d8-4ed0-9605-16250a4d8734 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.443868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4ec12-9a5a-4266-bc2d-a1ad89636749 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.448680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.449111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.449588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.449889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.450150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.450804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.450910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:56.451180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.451577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.452069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.453249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e5e28-ce5b-4bd3-83d5-a7e524d1da7f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.465187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.467455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.470924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 175/358] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:56.472305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9421c-9b52-4df1-afe3-1bdc2e22ab73 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.472589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9421c-9b52-4df1-afe3-1bdc2e22ab73 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.472860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9421c-9b52-4df1-afe3-1bdc2e22ab73 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.476158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 176/359] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:56.484407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.484694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.484977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.489941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:56.491837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 184/360] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:56.492821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.506165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5fa9c-e9ab-4b8d-9508-7dae81489c00 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.509798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:56.511232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:56.517893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.518786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.518896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.519115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.520379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.522421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.524718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 177/361] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:56.525829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.535714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c41854-0ae4-4b55-81e2-8ed0d6ce93a3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.542489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.543490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.543999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.544475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.545454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:56.545958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.547901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.561080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 178/362] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:56.562229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.573247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743625a-9a98-40a2-bed9-f15bc3fc367e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.578608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.579783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.580303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.580720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.594361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.596704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.616296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:56.617757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 179/363] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:56.618652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.628922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a9bb-9d39-4691-a69d-e7d890fe2551 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.634019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.634894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.635323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.635741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.636679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.637830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:56.637830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:46:56.637830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:46:56.639336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e57d0-9a4a-4d2b-80cb-7bc6e1772279 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.639719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 185/364] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/users => generated 248 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:56.640676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.660213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc981f62-aade-4ed5-b7c2-e986f5cb2b1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.670760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.671504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.671783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.672131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.672890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:56.673193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.674366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:56.674366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:56.674366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:56.675265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.698232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 186/365] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:56.705084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:56.718223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8244e-667c-40f6-84c4-4354e1501f8d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:56.723500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:56.724238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:56.724520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:56.724794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:56.725570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:56.727625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd397735-ed33-4fdc-89ce-c7d2d90c7493 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:56.741535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 180/366] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/users => generated 248 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:56.829370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 187/367] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:56 2022] POST /identity/v3/users => generated 246 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:46:57.156598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dea53-a5c4-46bd-b563-887969f4544d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.156898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dea53-a5c4-46bd-b563-887969f4544d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.157153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dea53-a5c4-46bd-b563-887969f4544d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.159069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 181/368] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:57.167227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.167822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.168347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.191447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:57.193291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:57.203898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 188/369] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:57.230224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dea53-a5c4-46bd-b563-887969f4544d None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:57.250278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dea53-a5c4-46bd-b563-887969f4544d None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:57.255766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:57.256568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.256918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.257189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.269483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:57.271574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:57.293788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:57.295832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 182/370] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:57.303281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:57.318394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad24e1-8ace-44d4-a357-57a0c9b2b38e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:57.326561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:57.327234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.327520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.327798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.328564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:57.328873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:57.330550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4160d-aa47-4e77-bc73-00253d1517da admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:57.344724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 189/371] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:57.350825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:57.361129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3285a-ba27-4a7f-92fc-5c469768976b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:57.371056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:57.372037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.372532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.372980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.373871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:57.376035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0f194-a5a8-4da1-8917-41929551ca27 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:57.577211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 183/372] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:46:57 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:46:57.725468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5466b-8563-43a3-86a0-ab0c8897d84b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.726297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5466b-8563-43a3-86a0-ab0c8897d84b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.726805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5466b-8563-43a3-86a0-ab0c8897d84b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.729249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 190/373] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:57.736712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.736995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.737320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.765291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:57.766508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:57.779772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 184/374] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:57.821479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5466b-8563-43a3-86a0-ab0c8897d84b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:57.838243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5466b-8563-43a3-86a0-ab0c8897d84b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:57.845585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:57.846269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.846549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.846823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.847595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:57.849906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:57.894433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.sql.core [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 28 01:46:57.894433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 28 01:46:57.894433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [parameters: {'id': '04deb444badd4af2bafa18fd82e81ff7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 28 01:46:57.894433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:46:57.914225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 28 01:46:57.921061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 191/375] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 01:46:57 2022] POST /identity/v3/roles => generated 144 bytes in 100 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:46:57.928577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:57.938268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7c6ab-c208-418a-9d89-947dbcff28da None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:57.945955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:57.946771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:57.947052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:57.947318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:57.963296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:57.971557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4b6ad73f-5724-473c-8f0e-d1459ba23e79 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:46:57.973825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 185/376] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:46:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:57.980481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:58.000475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adb2d3-c289-4854-9b8a-52fcb63d20ba admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:58.009789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:58.010527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:58.010807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:58.011084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:58.011875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:58.012330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:58.014037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6b621-4c78-4d89-a7b3-4de6f49c7805 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:58.028435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 192/377] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:46:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:59.436311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b89ab1-b722-4274-8336-622b99db9c21 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.437330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b89ab1-b722-4274-8336-622b99db9c21 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.437884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b89ab1-b722-4274-8336-622b99db9c21 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.440141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 186/378] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:59.448801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.449723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.450229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.476737 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:59.478276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:59.491934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 193/379] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:59.532003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b89ab1-b722-4274-8336-622b99db9c21 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.549859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b89ab1-b722-4274-8336-622b99db9c21 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.554852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.555879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.556407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.556896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.568795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:59.580450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:46:59.582728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 187/380] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.589700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.599893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eefef-4cca-400a-b68f-8bd29755b8e6 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.607089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.608113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.608619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.609094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.610038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:59.610556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.612497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.625039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 194/381] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:59.631954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.642766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b46fb2-678e-454d-9d38-f47e60640d12 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.652523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.653742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.654231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.654711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.668775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.671102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.689838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c34face1-5aed-49e5-ba15-952a26f15e91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:59.691367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 188/382] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.698407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.708712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc042c-16ea-4c40-84fa-53d5475f264f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.719031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.720050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.720538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.721010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.722035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:59.722548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.724959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.744003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62174-ee40-496f-992b-43d946cf1241 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.744627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62174-ee40-496f-992b-43d946cf1241 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.745126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba62174-ee40-496f-992b-43d946cf1241 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.747088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 189/383] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:46:59.749049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 195/384] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:59.755033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f75a-51f8-483e-b802-d2cb80a8e145 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.755315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f75a-51f8-483e-b802-d2cb80a8e145 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.755588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f75a-51f8-483e-b802-d2cb80a8e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.756855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.768236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc582c1f-58fa-4b7a-9d1e-c506ca4fe035 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.774209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.774980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9b71f75a-51f8-483e-b802-d2cb80a8e145 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:59.775092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.775258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.775541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.776917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9b71f75a-51f8-483e-b802-d2cb80a8e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:59.784189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.785838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 190/385] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:46:59.786934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.787690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20f51-035a-4ce1-a2a1-6e63ff67dfc0 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.788258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20f51-035a-4ce1-a2a1-6e63ff67dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.788752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e20f51-035a-4ce1-a2a1-6e63ff67dfc0 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.790700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 191/386] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:46:59.798364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.798935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.799414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.802669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:46:59.804292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 196/387] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.809987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.819608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:46:59.821183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:46:59.821292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412bf1c-0f7b-4b16-b82c-59386c16c6cb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.826422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.827157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.827517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.827868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.828882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:59.829264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.830447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:46:59.830447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:46:59.830447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:46:59.831682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 192/388] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:46:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:46:59.831808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.832879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.843254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744a437-2b39-4f58-9f6a-ed5c02612baa None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.851087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.852328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.852851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.853306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.866538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:59.874028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:46:59.875846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 193/389] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.877762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 197/390] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:59.883875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.885166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.894735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57fb1-fb0b-475c-8487-e7867d76170f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.896401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99a3cd-8378-4379-a1ca-32d625fbdcaf admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.900328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.901360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.901655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.902027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.902313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.902594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.902703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.903243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.903354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:59.903642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.905466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.916925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:46:59.917240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 198/391] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:46:59.918148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.925318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:46:59.927612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 194/392] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.929044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.934112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acaeb5-8ab4-4753-b83c-62ef38fbe407 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.939966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975271-5b56-4182-82ff-01483052006e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.940144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.940722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.941012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.941295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.946255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.947316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.947838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.948337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.951115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.953251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.961801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.964029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.964388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 199/393] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:46:59.965308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.979723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a9c0-6543-4075-a03a-908da128db29 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:46:59.984514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:46:59.985169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:46:59.985458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:46:59.985740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:46:59.986532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:46:59.986845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:46:59.987484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:46:59.989107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:46:59.990086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 195/394] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:46:59.991134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:46:59.999804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 200/395] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.000695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.002171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007808c-c717-47a2-9aa9-b9280b3c1a4c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.010931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.011732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.012040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.012326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.018101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a303b-a526-4ead-9091-1a1875ce4006 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.024229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.025245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.025536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.025994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.026513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.027399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.027687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.028248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.030082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.046374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 201/396] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.047046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.047862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.048290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 196/397] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.058738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.061843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cf6d7-456f-43f9-8bf5-9253a64b9ae3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.067944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.068599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9c55-49f8-4541-ae68-515e23a19e8c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.069318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.069887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.070434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.073027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.074041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.074041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.074322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.083611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.084216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.086278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.086527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.103016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:47:00.106488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.108065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 202/399] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.108276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 197/399] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.109202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.110759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.121722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb2e48-339a-42b5-873d-184723c5030d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.122309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cae7e4-916c-48ca-ae82-fe1dfef44efb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.126853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.127284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.127475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.127752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.128113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.128874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.129004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.129483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.130383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.130515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:00.130515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:00.130515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:00.131111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.131630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.132306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.132828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.134673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.156611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 203/400] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.156611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.168539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4358-d65f-4801-98ea-7f6f7acec1a7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.173535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.174359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.174867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.175350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.176926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.177427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.178147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 198/401] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:00.179062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.179487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.192858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 204/402] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.193780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.198866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975ffc-4c58-48f8-b452-61c1ff793fc8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.203475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5e9c-1c7f-48d6-8a84-1a029c83f471 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.204752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.205750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.206225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.206635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.209836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.210581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.210962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.211340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.215611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.218063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.221938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.224448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.239186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 205/403] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:00.239186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.241573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:00.243466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 199/404] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.244668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c909a29-f26c-4b5c-a534-862698a3c865 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.245383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.249787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.250575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.264242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.264242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.264242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.264242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.279088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:00.280809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 206/405] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.281642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.298455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5267b-3d99-4200-a78c-0650b45e5ea9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.303543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.304418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.304710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.304993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.305864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.306205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.307396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:00.307396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:00.307396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:00.308734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.330766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 207/406] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.331764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.343479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6240a29-cc56-4587-b6b6-8d2ad95840a2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.349502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.350266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.350559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.350842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.351911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.352286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.354445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.379498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6d00-e5e2-43bf-bf6f-f739cc5b81b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.385476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.386551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.387122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.387535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.391184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 208/407] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.392099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.405639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.406140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55775e-ca2f-40b6-98e8-ce01c8253c13 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.408046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.412426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.413187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.413472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.413750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.414645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=8912268c49fc4532a9b920995b286ed9) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.414961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.417506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.424474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 209/408] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/role_assignments?user.id=8912268c49fc4532a9b920995b286ed9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.425273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.428342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.435144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 200/409] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:00.437485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.440958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315c7e-1ff9-4eaf-a3a8-73d7580a88d6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.448088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.448088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.448088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.448088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.459906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0a65f-7af6-42f0-bdbb-0450389f145b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.460155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.463997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4f0d6-96b8-464b-9253-4a8155e36a7f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.472954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.474071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 210/410] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:00.474563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.474946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.475357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.475458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f79bf-9412-45ac-977c-5c7490d19a7a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.475713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f79bf-9412-45ac-977c-5c7490d19a7a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.476005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f79bf-9412-45ac-977c-5c7490d19a7a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.476527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.477006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.477816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 211/411] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:00.479043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.488112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.488694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.488694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.499380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 201/412] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:00.500283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.510989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d298-aecc-43aa-9dcc-5d450a26a869 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.512958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:00.514940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:00.515860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.516719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.517005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.517287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.532032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.532032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.532541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 212/413] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:00.534001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.546723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11afec0-2945-47da-95dc-00d34bc2502c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.556126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.556126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 202/414] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.558228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.561467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.562651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.563189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.563676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.572020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472fea0-c720-4a1c-a806-6265afac6cc3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.577852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.579866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.583725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.584437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.584720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.585000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.585752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.586062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.587699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.602084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 203/415] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.602973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.604164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:00.605664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 213/416] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.609603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.618328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839c431-7c1c-4f35-a068-7ed07eefa567 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.622685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12209f-c9e5-4c51-8f2f-c28ab4df09d2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.623157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.624030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.624325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.624605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.628847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.631248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.631735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.632328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.638002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:00.640776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.642877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.645863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:00.647160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 204/417] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.647855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.658572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5681cf-c2e3-4444-a3e3-505a3649471e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.663426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.667994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.667994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.667994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.667994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.667994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.668419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:00.668419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:00.668419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:00.668615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:00.668696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.670204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 214/418] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:00.671059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.692109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258bab2-6e9b-464b-8114-8506133d6ebb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.695257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 205/419] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.696242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.697042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.697763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.698049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.698434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.699125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.699485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.701363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.707822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236615-deb7-436c-abd1-e31d60165f75 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.712388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 215/420] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.713085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.718780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.720124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.720516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.720894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.722037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.722443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.723357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac07da3-d36b-4105-af5c-71e16a433d3c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.725225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.728739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.729374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.729707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.730036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.730858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=d6a1d87117d143488e1701ac0407ff28) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.731221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.733763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.740020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 206/421] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.741063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.746180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 216/422] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/role_assignments?user.id=d6a1d87117d143488e1701ac0407ff28&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.747374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.752196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d359-4afe-45a1-83cc-07e61012636e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.760946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699cb6f-15a5-4940-b331-640977d87907 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.762323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.763326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.763683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.764125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.765804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.766783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.767150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.767503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.768915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.769314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.772209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.780409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.781935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 217/423] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.782470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.806598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:00.808298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 207/424] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.814905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.827112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43d8ac-210f-4da7-b370-4f09eee775a0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.833773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.834748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.835164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.835545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.836496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.836931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.838831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.855564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 218/425] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.862553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.875292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959100-ce11-4b79-88f7-51af6cc95e74 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.882127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.883191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.883580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.884106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.893970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.896985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.913233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:47:00.914964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 208/426] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:00.921163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.933833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfb288-bde6-4469-a544-6f23879c2c0b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.939002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:00.939906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.940517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.940910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.943250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:00.943684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:00.945936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad69c7-4f97-4729-ad16-5342901f02a9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:00.969841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 219/427] 10.222.0.79 () {56 vars in 1160 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:00.977561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:00.990714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfbcf7-c030-4683-bbb2-60ad3e9f0dbf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:00.991834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fd49-cc2a-401a-97b6-20d6404d9e3c None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:00.992253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fd49-cc2a-401a-97b6-20d6404d9e3c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:00.992696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fd49-cc2a-401a-97b6-20d6404d9e3c None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:00.995460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 220/428] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:01.000427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.001243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.001631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.003222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.003611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.004571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.007091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.027752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.029579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.042983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:01.044236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:01.046824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 209/429] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:00 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:01.054289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.067462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89e48-9934-4a2c-bd50-9151fb7d2640 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.069924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 221/430] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:01.079773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.080590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.080868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.081138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.099838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.103536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.127784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.134982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:01.140243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 210/431] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:01.146755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac171ef6-2217-4f6f-a1d0-2f0247b46e26 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.149444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.160236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afaf17-7232-4d21-8d73-ee8719de02ce admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.165304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.166256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.166682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.167118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.168014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:01.168570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.170483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.173677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.173977 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.174261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.174535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.186102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 211/432] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:01.193245 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.204416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44821b8b-1452-4017-974f-8e92dc03ae93 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.209153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.209669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.210661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.211019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.211319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.211798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.219949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.223289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.237721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:01.239780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 212/433] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:01.246190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.255830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:01.257340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c85cd-5848-4082-95d1-09feceb73668 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.262107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.262973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.263402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.263942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.264878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:01.265304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 222/434] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:01.265762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.267990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.271514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.281236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 213/435] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:01.289155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.294365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850c208-de32-4439-8b70-50f2fd1e8e5e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.299625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634e1ba-b88f-4440-adfd-09710e0b3fd4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.305665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.306539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.307000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.307438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.308571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=87f23bd8046049038d1a5543cce545e9) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:01.309214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.309502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.310155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.310434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.310708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.311420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:01.311722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.312366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.313339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a47c5b-1333-417d-aa16-fdc54f693e26 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.318950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 214/436] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/role_assignments?user.id=87f23bd8046049038d1a5543cce545e9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:01.351034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 223/437] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:01.356945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:01.368881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2722e-aebf-490e-a287-55f607670bf8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:01.380355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:01.381292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:01.381768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:01.382215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:01.383211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:01.385457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b090-83f3-4eae-808c-81b21541bbb7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:01.480955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 215/438] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:47:01 2022] POST /identity/v3/users => generated 247 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:03.242096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8fc5-22a6-4040-9518-b8fc820a8895 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.242621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8fc5-22a6-4040-9518-b8fc820a8895 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.242621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8fc5-22a6-4040-9518-b8fc820a8895 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.244449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 224/439] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:03.255193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.255193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.255193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.281025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:03.282791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:03.299411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 216/440] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:03.327339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf8fc5-22a6-4040-9518-b8fc820a8895 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.355723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf8fc5-22a6-4040-9518-b8fc820a8895 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.366718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.368062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.368469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.368776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.393001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:03.401435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:03.403998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 225/441] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.410681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.424723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0653b9-eaa0-442b-b9ef-6236fbd5ca66 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.435829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.436917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.437409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.437890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.438872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.439387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.441303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af7a0c-a974-4fb7-8579-3ebd983a8848 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.451454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 217/442] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.457571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.474154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624ded9-448d-4d10-accc-a78bb0f06214 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.484204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.484992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.485271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.485545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.492874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23a4f-79ff-4838-a86e-fbb3b864c132 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.493493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23a4f-79ff-4838-a86e-fbb3b864c132 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.494001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23a4f-79ff-4838-a86e-fbb3b864c132 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.496320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 218/443] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:03.505013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.507265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.513295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a74e-bc48-4e92-abd8-ec3aa7a5bb32 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.513892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a74e-bc48-4e92-abd8-ec3aa7a5bb32 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.514372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a74e-bc48-4e92-abd8-ec3aa7a5bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.531622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-46dfffad-afbc-49b3-b6c8-734d8e7277c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.536698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f177a74e-bc48-4e92-abd8-ec3aa7a5bb32 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:03.537976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 226/444] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.538568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f177a74e-bc48-4e92-abd8-ec3aa7a5bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:03.539680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd799-205f-4d36-ad4e-b34492505cdf None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.539920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd799-205f-4d36-ad4e-b34492505cdf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.540233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fd799-205f-4d36-ad4e-b34492505cdf None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.545936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 227/445] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:03.545936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fd799-205f-4d36-ad4e-b34492505cdf None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.564076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 219/446] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:03.565032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fd799-205f-4d36-ad4e-b34492505cdf None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.567184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.569141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.570277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.575271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.577373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.579090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.579542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.580427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.582613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.584486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.599861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:03.601320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:03.610173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 228/447] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.611251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.612354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 220/448] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:03.629052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.638516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd878152-aa2c-4f74-946e-a16944706171 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.642346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b935c-d7b0-47aa-bcfb-ca53de80a927 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.645934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.646746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.647030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.647313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.648421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.649376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.649664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.649936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.657799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.660593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.660894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:03.667864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:03.669271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 229/449] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.669867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.676465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:47:03.678412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 221/450] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:03.679274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.685876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01c081-4762-4b3b-bc0b-e8e22ec6ba32 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.688959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7474e5-3ccd-4fe1-a553-70cb11ff2e40 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.690793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.691816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.692246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.692685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.695239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.696030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.696421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.696800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.697675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.698086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.699747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.704326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:03.711665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:03.712976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 230/451] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.715205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 222/452] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.716221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.720452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.736610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce12d-249f-400a-bbe2-a902e27207a7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.739095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee486b-e123-4d11-9361-dcd29b100efb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.742097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.742951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.743308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.743598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.743814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.744372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.744608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.744708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.744892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.745166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.746050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.746255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.746351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.748896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.761028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 223/453] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.762962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.777571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 231/454] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.778427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163af3-ec24-43a1-b4c1-c4d55cfb517b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.778538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.790725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.791748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.792178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.792462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.794091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e5ddc-5c8e-4959-b7b0-22f242b3f769 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.799226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.800120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.800478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.801372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.807054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.808998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.814053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.816245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.830727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.832856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 224/455] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.834277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.835814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.837403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 232/456] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.838859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.852080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfb6d8-c179-4c61-b315-5b328d929121 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.855339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64156dca-eea9-4e0a-93d9-ec3b72c18d91 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.857662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.858712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.859079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.859361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.860248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.860981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.861341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.861697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.862694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.863359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.866478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.873082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.875461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.880198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 233/457] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:03.881095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.891061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b3579-ab66-4863-8282-93f9cdec017c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.897808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.898854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.899321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.899778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.900122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:03.900951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.901676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.901862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 225/458] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.902286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.905198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.921780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec901e-d5d2-412d-bae0-c4bca4f6c377 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.933023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 234/459] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.933592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.934462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.934648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.934876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.935043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.946554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.949023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.949829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1295-bbb6-4bf3-8555-72b8b8b3fef3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.954855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.955584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.955880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.956212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.957683 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:03.958299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:03.960880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:03.966149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:47:03.967596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 226/460] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:03.968222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.976540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 235/461] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:03.977465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:03.985041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f983ea-1613-4249-b11c-f2f2e41c5bee admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.991750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.992629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f6aeb-58bb-4fab-a318-a9c99e71488f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:03.992823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.992981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.993162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.997495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:03.998279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:03.998572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:03.998854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:03.999752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.000098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.001577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.002142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.003592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.021928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 236/462] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.022727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:04.022914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.024361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 227/463] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.030049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.033632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededbae4-9056-46fb-9db4-09687da55ba1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.039437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.040262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.040550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.040831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.041641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74dbe5-ddbc-4f8d-90ff-725d80a0458c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.046084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.046855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.047142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.047420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.048598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.050765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.060577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.062444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.064957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:04.066429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 237/464] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.067241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.087657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0831-672b-4fa9-8f04-a8ffcf06222f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.092422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.093079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.093363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.093676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.094506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.094809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.096901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.099165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-8478ead0-2bfd-4892-97ad-6c7d1f6bbb35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:04.100555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 228/465] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.101678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd475-6f36-4b4e-af57-d7bde7359fcf None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.101958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd475-6f36-4b4e-af57-d7bde7359fcf None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.102233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd475-6f36-4b4e-af57-d7bde7359fcf None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.104110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 229/466] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:04.104892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dd475-6f36-4b4e-af57-d7bde7359fcf None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.118892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dd475-6f36-4b4e-af57-d7bde7359fcf None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.123583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.124268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.124582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.124878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.125605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.125913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.127770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2151efe-641b-4a47-848d-8603c014368c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.140930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 238/467] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.140930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.160812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 230/468] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.160812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.160812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.160812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.163888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63245cf4-3e5f-4b8e-8b8c-19d1fc031c22 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.168281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.168928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.169207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.169478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.170184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.170489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.172186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.186815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:04.188211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 239/469] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.188834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:04.193435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.201229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 231/470] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:04.202820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.203385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1977c-43e9-4297-836d-6cf877bd9462 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.217482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.218281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.218615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.218892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.219184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70b3a3-de90-48ed-bbb8-3eab9bfce955 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.228140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.230235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.231013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.231525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/8912268c49fc4532a9b920995b286ed9/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.231637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.233939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.252148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=8912268c49fc4532a9b920995b286ed9, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.252338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:04.261496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 240/471] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.261496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.262944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.272286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc3ddb-26fe-4e63-b9ec-bdbaeb38af4c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.276990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.277790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.278069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.278346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.287531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.289543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.304097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:04.305575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 241/472] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.306352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.317181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc2946-dd69-43ab-aa67-966ac373b733 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.322100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.322890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.323177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.323450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.337681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:04.344855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:04.346052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 242/473] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.346876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.357060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bad35a-33ff-448f-b510-d352d5eea248 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.362075 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.362746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.363032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.363474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.364182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.364493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.366151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.376273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 232/474] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:04 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/8912268c49fc4532a9b920995b286ed9/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:04.376273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.397435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 243/475] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.398570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.410601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45423bf-ebd0-4f1c-8aa4-bf5220cc4dd6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.468482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d6b2-d2d7-4001-ab12-8ecc7c287c7c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.474056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.474732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.475016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.475380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.476247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.476553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.478432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.491211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.492100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.492297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 233/476] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.492583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.492961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.493154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.494021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.494426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.496156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.504407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f1ab4-ac8b-41fe-906d-7c94b6a13a0b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.506699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 244/477] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.507783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.511044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.512914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.513513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.514101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.521067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ef87-1d98-4a2b-9356-119d3045ca05 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.526350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.527545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.528025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.528486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/d6a1d87117d143488e1701ac0407ff28/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.528907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.533924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.547787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=d6a1d87117d143488e1701ac0407ff28, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.550985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.553006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:04.559888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 234/478] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.561043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.574486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b609-a8e2-4aa5-9f19-7ef5d6d2e1d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.579529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.580711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.581130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.582549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.596823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.605000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.620617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:04.621901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 235/479] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.622688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.631207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 245/480] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:04 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/d6a1d87117d143488e1701ac0407ff28/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:04.632325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.635126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d671f74-9617-4bae-ba3d-a1fdb884056d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.697522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.698439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.698864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.699315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.700335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.700818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.702894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ad710-af56-4c3f-80cc-ba260a74ffaf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.711215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be5791-9286-495c-bd80-f59dd941b429 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.717754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.718435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.718913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.719020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.719165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 236/481] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.719696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.724151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.724151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03241279-3f98-407b-9a7c-3bce4e4ec2b5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.725623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b8bb-3130-4c82-8053-1a2ff87e3161 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.725915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b8bb-3130-4c82-8053-1a2ff87e3161 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.726254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b8bb-3130-4c82-8053-1a2ff87e3161 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.728446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 237/482] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:04.731958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55b8bb-3130-4c82-8053-1a2ff87e3161 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.735901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 246/483] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:04.737394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.737681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.737964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.745915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55b8bb-3130-4c82-8053-1a2ff87e3161 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.757221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.758121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.758494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.758905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.759807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:04.761083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:04.770562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 247/484] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:04.771487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.779148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=77dde5aa087649f5873dc17c6fc175c5, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.782197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.782998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97204e9f-814c-4319-b202-63881353e5d3 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.797387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.798996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.799702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.800312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.817971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.822108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:04.850982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:47:04.853704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 248/485] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.855099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.871587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fc53-a30c-4125-a13a-ce6e68fcd110 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.876510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.877542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.877834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.878105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.882554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 238/486] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:04 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:47:04.884226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.905136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:04.922492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:04.924122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 249/487] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:04.932172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:04.954768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc818b05-52b3-4966-b46e-a7c55295b436 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.975032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb6c-df2b-4f0f-826a-e6f3986a1fd9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:04.981814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:04.983288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:04.983807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:04.984333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:04.985566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:04.986148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:04.989004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.017082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 239/488] 10.222.0.79 () {56 vars in 1160 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:05.021036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.033452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d596b48-9275-4b41-9123-71ae9969f79d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.040863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.042166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.042724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.043297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.058068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.060831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.090932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:05.092471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 240/489] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:05.095336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.097196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.097196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.098180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.099617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.100217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.103351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.112646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.122373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 250/490] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:05.127860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.134857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf54786-4438-496e-86bd-beaf5d616174 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.147521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.147521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.147880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.148072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.148815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.149160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.150757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.154367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f276e9-40d3-48b0-971b-63d8f10c65be admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.163471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.164633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.165248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.165762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.176711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 241/491] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:05.178934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.181086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.182528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.200374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:05.202265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 251/492] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:05.202371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540ef2-3d2a-4c13-a51b-610991f3569b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.209626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.217690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.218522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.218811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.219092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.222027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55eb1-7ce3-49dc-9fac-1e290b88e179 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.234421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.235149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.237485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.237984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.239046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.240056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.241473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.242059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.246192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.268059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:05.272070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 252/493] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:05.273960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 242/494] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:05.280238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.283919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.298693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85ff52-85ca-488f-9013-2bf5bb56fc6e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.303463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aa519-3a9c-4432-8b9c-6d67ec5d8651 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.308052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.308776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.309054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.309332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.310197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.310522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.312506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.317383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.318210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.318496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.318776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.338339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.338339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.344373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 253/495] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:05.351435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.366267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:05.367877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 243/496] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:05.370970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eef02c-c206-4acf-b978-7bd16f7b219f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.376934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.387273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.388336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.388691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.389037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/87f23bd8046049038d1a5543cce545e9/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.395908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397e3c-1e50-461f-9956-f18f7aec0130 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.409805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=87f23bd8046049038d1a5543cce545e9, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.413917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.415661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.416482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.416837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.417177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.418132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.418510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.424005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.443077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 244/497] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:05.449291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.468076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a31e37-5069-436f-9998-5eeceb09e1b8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.478225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.478898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.479190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.479464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.489087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.491006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.501906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 245/498] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:05.504653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 254/499] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:05 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/87f23bd8046049038d1a5543cce545e9/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:05.519216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.532705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca75c51-3c7c-4d07-9a0f-4f3dba42993e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.634939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.636720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.637348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.637814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.654234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.656540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.692601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:05.694715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 246/500] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:05.702614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.720098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c74dd-f583-4a1b-932a-a4b32d0bc74f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.728181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.729229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.729725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.730220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.731370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.731916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.734333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.749204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 255/501] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:05.756961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.770366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebeb80b-2697-4be0-9ad6-937082f27c75 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.779115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.780236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.780621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.780997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.790204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.792408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.806950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:05.809319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 247/502] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:05.816998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.828163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e039-0d23-4218-af22-57feeee4521a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.833829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.834617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.835007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.835392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.836351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.836767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.838831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c2b1-5839-4a18-9395-5af485b09650 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.852690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 256/503] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:05.865425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:05.882361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a162a-bf19-406a-acfc-d3dd35d16f20 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:05.891841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:05.892694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:05.893076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:05.893482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:05.895088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=7a31cb414c8c418b96621a93ba3fff06) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:05.895659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:05.898299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174220-458a-4004-9479-65756524f0c4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:05.908737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 248/504] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:05 2022] GET /identity/v3/role_assignments?user.id=7a31cb414c8c418b96621a93ba3fff06&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:07.305596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966236-0487-4e36-a2c8-b08e559271b1 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.306631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966236-0487-4e36-a2c8-b08e559271b1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.307154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89966236-0487-4e36-a2c8-b08e559271b1 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.309662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 257/505] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:07.323476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa354-fa6f-4f2e-8430-8ced15e52a13 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.324047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa354-fa6f-4f2e-8430-8ced15e52a13 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.324478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa354-fa6f-4f2e-8430-8ced15e52a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.360402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d0baa354-fa6f-4f2e-8430-8ced15e52a13 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:07.361621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d0baa354-fa6f-4f2e-8430-8ced15e52a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:07.374865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 249/506] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:07.426391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89966236-0487-4e36-a2c8-b08e559271b1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.432800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52100b-cc3c-45b2-8898-7fb9cf11df8f None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.433079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52100b-cc3c-45b2-8898-7fb9cf11df8f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.433352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52100b-cc3c-45b2-8898-7fb9cf11df8f None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.444176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 250/507] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:07.446017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abe90-6212-4df0-beae-8241502740cc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.446393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abe90-6212-4df0-beae-8241502740cc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.446798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872abe90-6212-4df0-beae-8241502740cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.452999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89966236-0487-4e36-a2c8-b08e559271b1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.468336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.469138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.469416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.469685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.482636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-872abe90-6212-4df0-beae-8241502740cc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:07.483823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-872abe90-6212-4df0-beae-8241502740cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:07.492669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:07.503559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:07.507179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 251/508] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:07.512109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 258/509] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:07.514799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872abe90-6212-4df0-beae-8241502740cc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.524674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872abe90-6212-4df0-beae-8241502740cc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.529233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.529960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.530240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.530514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.531266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.531568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.533185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.549045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.549917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 252/510] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:07.559336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.563589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d04e7-c400-4b25-b6e1-1d293fc27b77 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.575549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.576425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.576707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.576976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.579432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e82405-609d-4af0-8ae1-cf3202f51e24 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.592955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.593749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.594032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.594373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.607416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:07.614724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:07.617627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 259/511] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:07.620380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.622434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.625064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.642173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:07.643689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 253/512] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:07.648762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf2c-bd7c-42c7-9782-6becc586e94c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.656985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.659587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.661183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.661527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.661873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.662811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.663314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.665261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.670400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02ba35-f25d-4c3f-823a-7505abf87cb6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.678477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 260/513] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:07.684971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.692291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.692291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.692291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.692291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.692965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.692965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.694059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.703254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd2b2-b142-4aec-9a0c-4f4cae0044d6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.709473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 254/514] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:07.713067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.714329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.714682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.715027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.716507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.734852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7bafad-2519-4464-b413-871373adc23e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.745440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.746987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.747245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.749274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.749680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.750030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.766248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.768400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.785868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:07.790537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 261/515] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:07.795870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:47:07.797438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 255/516] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:07.799305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.806079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.812185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cf2a2-10cd-44c8-adff-6dcebe08b3ef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.818459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7eb568-51c9-4fab-8d69-3241b7cc1c80 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.823166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.823823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.824136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.824411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.825243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.825549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.827374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbad3ac-ae3b-463a-818e-f3b980abe0d2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.828275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.829643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.830349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.831064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.832688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.833457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.835432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.847277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 256/517] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:07.848227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339927-6dd6-4f5f-8506-2100b17c1359 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.848509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339927-6dd6-4f5f-8506-2100b17c1359 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.848780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339927-6dd6-4f5f-8506-2100b17c1359 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.850437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 257/518] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:07.850703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 262/519] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:07.857009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339927-6dd6-4f5f-8506-2100b17c1359 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.858435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.875203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ec8e-f738-4ed2-88c4-8b4add4a55e0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.876404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339927-6dd6-4f5f-8506-2100b17c1359 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.881230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.881666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.882304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.882581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.882852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.882954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.883421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.883865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.892750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.893346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.895433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79153b2-eb44-4f29-a5ba-6dfbeda8eadc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.896603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.906785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 258/520] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:07.908132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.908420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.908693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.913449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:47:07.915056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 263/521] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:07.916005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.928379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054384-72ec-4c20-a799-9f5f936da3bc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.933562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.934279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.934541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:07.934646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.934900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.936325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:07.946800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 259/522] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:07.948249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:07.948700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.950541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.959831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a213a-5cf7-429b-b45c-69a46f86371c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:07.978297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:07.979282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:07.979438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:07.979882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:07.980396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:07.980817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 264/523] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:07.981842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:07.982152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:07.990688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:07.992001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.003728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d0098-343d-48a2-aaeb-546bd245b25b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.009024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 260/524] 10.222.0.79 () {56 vars in 1158 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.009853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.021227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.021505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e39-d4c7-49c2-b764-f0f58aa06e9b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.021896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.022184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.022464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.023317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.023628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.025424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.027745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.028771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.029270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.029740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.041926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 265/525] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.043157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.044165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:08.053296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:08.053922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073e47-ef3f-4033-a7ea-eacc86e02033 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.055383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 261/526] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.061022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.061022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.061022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.061022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.062144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.069215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.072448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.074416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a7d8-11ef-437a-8d4d-793027cee7d4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.079536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.080638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.081103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.081556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.084746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 266/527] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:08.088421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.100373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.101958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3d6a-bc52-4872-b418-09fa4704ff09 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.102903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.108232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.109202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.110073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.110446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.111268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.111718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.114035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.119093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:08.120932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 262/528] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.122036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.124447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 267/529] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.129978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.138087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50a31-c7e9-4d48-82e5-02bdd8da2fa7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.138880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6cb43-7ecc-4d03-bafe-1b56ef03f2b6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.148089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.148349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.149174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.149339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.149640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.149937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.150098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.150492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.151598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.152078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.154874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.163023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.165094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.170849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 268/530] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.171964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.185219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:08.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0483eb6-3e4e-404f-89b8-827d79182433 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.192020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 263/531] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.192020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.200814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.201766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.202156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.202531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.208530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4283-3b3e-498a-acd6-9a6beeb332f4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.214892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.216070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.216523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.216757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.217095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.218064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=8912268c49fc4532a9b920995b286ed9) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.218519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.219129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.221094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.230211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 264/532] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/role_assignments?user.id=8912268c49fc4532a9b920995b286ed9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.231337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.237798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:08.239875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 269/533] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.243629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ce478-ab32-465c-a6e7-645560e4500f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.249673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.263286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.264113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.265863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.266168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.266990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.269948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.271827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.277517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe1a1d-75c9-416b-b793-edb7a9c0054d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.290710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.291428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.291718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.292050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.292956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.293266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.297076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.305174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 265/534] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.315912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.335343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 270/535] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.336415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5d203-0b69-4278-a726-d81e060d131c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.342424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.349203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.350753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.351038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.351314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.354300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c74fd-2b04-4270-84d9-c6265cc7eb8f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.361868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.363204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.364750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.365037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.372117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.374363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.382349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.384481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.399383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:08.401081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:08.402720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 271/536] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.409349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 266/537] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.409571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.417786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.422649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6089ec-6e9e-4b79-90c6-1cbff4b6fd3b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.428117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.428804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.429089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.429414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.430262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.430629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.433008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5989-0006-4742-840d-11775f34b05a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.437959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137454b9-d6b6-437e-85cd-af18e1469ca9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.444435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.445251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.445586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.445863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.448065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.448065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.450233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fb5f-005d-4e57-8424-0d14b0dbb19a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.454069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 272/538] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:08.455396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290fa2-53b8-4431-9efb-5e69c85ddfe0 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.457277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290fa2-53b8-4431-9efb-5e69c85ddfe0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.457277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e290fa2-53b8-4431-9efb-5e69c85ddfe0 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.459438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 273/539] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:08.462219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e290fa2-53b8-4431-9efb-5e69c85ddfe0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.468723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 267/540] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.469006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.469189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.469468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.489053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e290fa2-53b8-4431-9efb-5e69c85ddfe0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.497278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.502216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.502216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.502216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.502430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:08.502430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:08.508709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.510452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.513204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 268/541] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:08.520942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.521999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 274/542] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:47:08.528402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.537788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcc837-4ae8-4df4-ade6-7343b0b7448b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.539428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b5c5c-7ac1-4136-be2e-c6a0e788cc15 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.546164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.546646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.546854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.547094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.547366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.547457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.547688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.547957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.548286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=d6a1d87117d143488e1701ac0407ff28) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.548594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.550836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.558324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 269/543] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/role_assignments?user.id=d6a1d87117d143488e1701ac0407ff28&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.559684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.573351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.575277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.578038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341baf6-b312-4d70-bc8e-07524e9714c5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.584003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.584999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.585287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.585565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.599034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:08.606346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:08.609373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:08.611011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 275/545] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:08.611172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 270/545] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.617882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.619035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.637537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc9784-e5b1-4bff-916d-09c860dec12f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.640426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f09bb-89ed-47e0-b117-ff1bec135993 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.648721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.649415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.649703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.649983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.650747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.651057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.652773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.655010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.655692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.655996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.656273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.657419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.657419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.658931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.667340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 276/546] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.673021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 271/547] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:08.678220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.679527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.689874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2214fb-5f1a-4257-bda8-e77d13229327 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.696065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49506d95-ccdb-4236-8d40-9913f705b15a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.696413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.697377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.697835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.698259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.709476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.710281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.710563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.710816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.710930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.713094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.730000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:08.731820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 272/548] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.739373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.741679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.743530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.751518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d895e-9290-4568-bd06-45483c80fe7f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.757939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.758834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.759803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.760280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.761253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.761745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.763791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.778871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 273/549] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:08.784042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:08.785985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.787494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 277/550] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.793889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.797334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0f18-786d-4df4-97ed-b865ecadc750 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.804315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.805642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.806719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.807187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.808394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.808869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.810989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.811353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142bf03-9630-46f2-8874-35db77e9088f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.818714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 274/551] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.826313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.826997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.827280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.827557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.828408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.828691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.830362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.855944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 278/552] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:08.862271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.881161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd4b7-e142-45e3-b9f3-2badae948135 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.888502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.889843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.890444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.890947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.907221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.909982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.927404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:47:08.933791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 275/553] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:08.936612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:08.949941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d228-14ce-423f-b3c0-3461b76d0131 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:08.956550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:08.958647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:08.959158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:08.959665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:08.960915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:08.961521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:08.963759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:08.989170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 279/554] 10.222.0.79 () {56 vars in 1160 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:08.997010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.013250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c5136-e835-448d-9eea-755d3d41c394 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.018794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.020075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.020359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.020793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.032388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.034195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8fb9d-a81b-4541-bf0d-8ef1782aee67 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.044956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 276/555] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:47:09.051401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.054490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e651-7f03-4eed-96c9-f4208ade0a53 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.054780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e651-7f03-4eed-96c9-f4208ade0a53 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.055057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66e651-7f03-4eed-96c9-f4208ade0a53 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.057240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 277/556] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:09.064856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.065146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.065430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.066701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae73c-6339-47f5-93a2-beb176653fff admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.071911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.072728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.073007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.073275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.087632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.088516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:09.089776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.090029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:09.100667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 278/557] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:09.110064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:09.111415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 280/558] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.118626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.125715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.130556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf957461-74ed-425b-93f2-0bfc558ea7f7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.137758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb80f-a675-4253-93e8-352078949265 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.138823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.139754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.140322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.140916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.142020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.142501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.144160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.144807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.146211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.146211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.147389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.162012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 279/559] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.163830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:09.169363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.171088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:09.172323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 281/560] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:09.179531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.181747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b8b0-6119-4391-ab42-3ae5c74d0ff5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.186687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.187657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.188119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.188608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.190670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c3ba-d2aa-4846-8f32-21a6ac23e90b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.196170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.196833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.197119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.197398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.198147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.198498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.199784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.200894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.202187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.213377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 282/561] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:09.216861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.218773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:09.220489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 280/562] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:09.227781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.228200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcdad-d06f-4bec-88d1-1739103ac5c3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.232799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.233586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.233871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.234150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.240182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95c9e8-43d2-406c-b8df-7c67e416efc9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.245257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.246550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.247095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.247708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.248192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.248563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.249646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.250050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.252526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.266818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 281/563] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.267778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:09.269256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 283/564] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:09.277310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.278817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.290668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf77dd7-1362-46aa-bf82-b93909b84550 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.294882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb52a5-f3e1-4d04-bae5-92d9a5c4f41e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.303208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.304086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.304854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.305301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.305725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.306505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.307387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.307812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.308255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.308719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.310400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=87f23bd8046049038d1a5543cce545e9) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.311622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.312133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.314100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.336001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 284/566] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:09.336530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 282/566] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/role_assignments?user.id=87f23bd8046049038d1a5543cce545e9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.341415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.355194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263ce1f-be7d-4901-a5d6-d7675b4ef06c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.368805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.369669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.369956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.370236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.385473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.387620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.412014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:09.413636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 285/567] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.420149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.439570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb82525-5a9d-4c77-9ff8-96b8365f34d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.453939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.454535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.454817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.455087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.455942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.456272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.458578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.488631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 283/568] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.495030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.509320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ebd2c-a611-4d16-a5bb-e1f290375888 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.524792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.525621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.525905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.526177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.545268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.547151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.567420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:09.568658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 286/569] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:09.575108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.585666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823fb2-2aaa-4ea9-83ee-47dceec951a9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.592173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.592818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.593099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.593372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.594090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.594393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.596337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.613563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 284/570] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.620382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.630468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c43b-033d-4838-9eb7-db351e8c1dae admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.637309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.638106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.638393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.638672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.651494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.653898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.677905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:09.681220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 287/571] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:09.690169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.706061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1f1fd-1c28-41de-bad5-3db8f073d64e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.710818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.711677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.711959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.712262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.713091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:09.713401 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.715592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc1535-acad-4912-8bf3-d5948455d015 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.731180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 285/572] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:09.738800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:09.749453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a9519-f558-424a-b1e4-0a77faa29dc4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:09.754817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:09.757314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:09.757782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:09.758069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/7a31cb414c8c418b96621a93ba3fff06/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:09.775337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=7a31cb414c8c418b96621a93ba3fff06, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:09.778107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866e64-3058-4c88-a3a6-2487383e2a9b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:09.854833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 288/573] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:09 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/7a31cb414c8c418b96621a93ba3fff06/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:47:11.077980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60cc4-88c7-44e5-a396-65865b274f99 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.079006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60cc4-88c7-44e5-a396-65865b274f99 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.079484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab60cc4-88c7-44e5-a396-65865b274f99 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.082498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 286/574] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:11.090687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.091605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.092105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.121872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:11.123395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:11.222494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 289/575] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:11.258751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60cc4-88c7-44e5-a396-65865b274f99 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:11.278330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab60cc4-88c7-44e5-a396-65865b274f99 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:11.284387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:11.285635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.286119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.286565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.287387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:11.288590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:11.288590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:11.288590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:11.289778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:11.309645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:47:11.311144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 287/576] 10.222.0.79 () {56 vars in 1150 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:11.318691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:11.328875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1075fb4-404f-44aa-8ed9-dbe42e9028c2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:11.336473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:11.337519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.337977 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.338421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.339657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:11.340226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:11.341492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:11.341492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:11.341492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:11.342665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6444c5-511e-455b-b53e-66171abed405 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:11.352175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 290/577] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:11.359005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:11.385135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722d2c-4566-48d8-ad03-909f05d4561b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:11.397216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:11.398362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.398856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.399411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.400792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:11.401344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:11.403188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:11.403188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:11.403188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:11.409103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad858b-63f1-4470-bde8-0225f7e77aa3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:11.420255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 288/578] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:11.781937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea910-6eea-4e33-87e0-476ed853e393 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.782472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea910-6eea-4e33-87e0-476ed853e393 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.782896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea910-6eea-4e33-87e0-476ed853e393 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.785744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 291/579] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:11.793060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.793536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.793955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.814740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:11.816264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:11.829874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 289/580] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:11.883545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea910-6eea-4e33-87e0-476ed853e393 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:11.897867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea910-6eea-4e33-87e0-476ed853e393 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:11.908384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:11.909983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.910439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.910864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.933253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:11.940354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:11.941996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 292/581] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:11.951759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:11.961901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d69d4-978b-4b65-97e7-6b51cb998ad1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:11.973602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:11.974519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:11.974982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:11.975408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:11.976332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:11.976777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:11.978506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707fea-b94f-40a5-8ad1-4debd153857a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:11.988706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 290/582] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:11.998327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.015289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adf58d-8e2e-4cfe-a726-0c0dcf2db1e0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.030021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.030831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.031115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.031389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.052820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.054678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.075263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:12.076799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 293/583] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:12.080605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b06de0-a74f-4206-92a3-ef626555b592 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.081111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b06de0-a74f-4206-92a3-ef626555b592 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.082289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b06de0-a74f-4206-92a3-ef626555b592 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.086458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 291/584] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:12.087007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.099038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.099537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.100084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.102181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f3c1-2913-4b33-bd8c-e365d75ac4aa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.112767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.113842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.114321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.114794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.116153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.116725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.119550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.131644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:12.133973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:12.160520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 294/585] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:12.161068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 292/586] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:12.169558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.195799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815a387-b896-41e0-a38b-7bf3fd5e596f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.230201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.231593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.232154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.232714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.251508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.265055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.274645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ade7c-766a-4718-917f-544e19f8a7ff None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.276009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.297626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.300504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.302896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.304398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.342516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:12.349383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.351109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 295/587] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.353630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.358482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.390176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f794d-355f-402d-b931-912668e6e2ee admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.412030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.412030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.412512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.413073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.414643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.415196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.422134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c518-f504-46f0-8790-d16d9051d9c2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.427074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-021a110d-929e-4e34-b3ab-1bb89f1ca329 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:12.432029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 293/588] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.432702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34f8e-3f7d-4653-8c3d-cf0ee0ac98fc None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.433150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34f8e-3f7d-4653-8c3d-cf0ee0ac98fc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.433635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d34f8e-3f7d-4653-8c3d-cf0ee0ac98fc None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.437065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 294/589] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:12.452347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d34f8e-3f7d-4653-8c3d-cf0ee0ac98fc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.461830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 296/590] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:12.463397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.463879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.464619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.491168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d34f8e-3f7d-4653-8c3d-cf0ee0ac98fc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.493578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:12.495018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:12.505063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.506087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.506738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.507559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.509074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.509722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.511614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.514269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 297/591] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:12.515335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.531193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825d574-66f9-4a31-a4c9-7ca8fb657772 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.544430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 295/592] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.547420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.548399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.548906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.549384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.561393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.573048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.576482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.584571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68818c-b046-4dc0-b5b6-f05b94d3ef14 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.599839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 298/593] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:12.610384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.618481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.619629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.620158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.620691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.622103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.625937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.650876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516baed8-a1b0-47a2-a086-7e90d5cab775 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.663338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.664910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.665413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.665963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.670812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.670812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:12.670812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:12.670812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:12.671102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.696440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:47:12.704193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 299/594] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/services/network => generated 88 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.705705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.728701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2f01a-f409-4d03-8452-c45dfec158c6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.736832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.738819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.739412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.739927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.750068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 296/595] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:47:12 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:12.756178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.788110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcdb13-4d33-4b85-af3a-e0f57f4757b5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.793454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.797011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.801501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.802948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.803721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.804405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.808582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] RBAC: Adding query filter params (name=network) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.809443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.814808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.835318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 297/596] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.845308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:12.849000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 300/597] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:12.856549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.869521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.885325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c726549-eb1f-4dc9-8ccc-4d3b10c133fe admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.897628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.900918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.901517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.902197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.905393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] RBAC: Adding query filter params (type=network) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.906079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.907771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5163fc1-a45e-46ea-9dd6-fddd509c6afd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.911037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.923393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 298/598] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.933038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.934213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.934747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.935254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:12.936369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:12.937033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:12.938976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:12.960669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 301/599] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:12.970340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:12.986220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c681105-5bb9-4f61-b1d0-9a51e03eb3ed admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:12.996792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:12.998027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:12.998520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:12.999024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.013289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.015738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.034630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:13.036822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 299/600] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:13.043041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.055377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffdf3-72d7-4560-99b7-7c9dc40ef73e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.064994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.066653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.067252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.067730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.068795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.069331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.071451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec5c04-a122-4bc0-8961-07bf79c78dad admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.085302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 302/601] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.092745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.105604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb23625-aab9-474b-a55f-53c6b20d9f9f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.116666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.118239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.119031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.119801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.121506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.122197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.124563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf73bb-9128-4ab9-8552-f1fdef07cf0d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.137172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 300/602] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.546151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad736-5582-4878-b921-bc30792690e0 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.546773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad736-5582-4878-b921-bc30792690e0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.546773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad736-5582-4878-b921-bc30792690e0 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.548794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 303/603] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:13.556909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.557190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.557470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.576453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:13.577671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:13.589244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 301/604] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:13.615132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad736-5582-4878-b921-bc30792690e0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.628228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad736-5582-4878-b921-bc30792690e0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.634300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.635100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.635383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.635658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.648788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:13.655756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:13.657311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 304/605] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:13.666916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.676451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cbb17-2ba2-4b12-9c61-9654e5d657bf None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.681366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.682158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.682440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.682721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.683522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.683835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.685611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.702936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 302/606] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.710853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.726476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549a27a-fad1-43ed-9763-5e05002074d4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.731460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.732283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.732564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.732843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.744216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.746040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.763222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:13.764785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 305/607] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:13.773321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.787487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe20e04-7777-45e2-bde6-dc56ca8676bc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.803909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.804909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.805422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.805780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.806594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.806985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.808891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.822404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 303/608] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.830039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.849426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f7b07-e84e-44d6-bbef-a3b4fbbeb25d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.854328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.855125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.855408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.855686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.881559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.883637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.912841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:13.919452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 306/609] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:13.920562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:13.942585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bbbf6-db33-4e16-8e56-e6b69ce91df8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:13.950602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:13.951372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:13.951728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:13.952103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:13.953031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:13.953416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:13.955361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:13.984681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 304/610] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:13.991321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.006256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a90cd-0ee3-4fc9-9f13-3125e5d391fe admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.010788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.011436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.011720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.012013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.028324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.030096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.045995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 307/611] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:14.057385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.067695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5a71-328c-45ed-91f5-cb013471c349 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.080514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.081717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.082106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.082485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.099933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.101860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.126616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:14.128108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 305/612] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:14.134556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.152608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d86c1-4918-4949-abfe-ceb186a2c193 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.172755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.173452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.173740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.174062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.175841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:14.176295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.178053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.193722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 308/613] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:14.200433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.211265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8325c-c964-474e-a9ca-791b5c6ceaf3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.226040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.226841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.227126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.227401 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.242860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.245094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.266002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:14.268383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 306/614] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:14.274856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.293197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01c7f4-5c08-4111-bf0b-fbc66db4b1cc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.301104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.302070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.302633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.303120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.304205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:14.304796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.307015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c52080-23c6-4fa2-b542-75f6f98c8ba8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.329384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 309/615] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:14.336950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.354804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53209ad-1989-41c1-8c0e-6ca0a7e21a1b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.364766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.365440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.365722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.365996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.366843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=7a31cb414c8c418b96621a93ba3fff06) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:14.367155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.369049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbfc99-7379-4301-8303-32878c247114 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.375873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 307/616] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:14 2022] GET /identity/v3/role_assignments?user.id=7a31cb414c8c418b96621a93ba3fff06&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:14.682500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece21-c577-4986-849a-d348a8975255 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.683541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece21-c577-4986-849a-d348a8975255 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.684061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ece21-c577-4986-849a-d348a8975255 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.686381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 310/617] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:14.694589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24af8-a21e-49fa-9af5-93022a2bb2ff None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.694880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24af8-a21e-49fa-9af5-93022a2bb2ff None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.695141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef24af8-a21e-49fa-9af5-93022a2bb2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.719552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bef24af8-a21e-49fa-9af5-93022a2bb2ff None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:14.720823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bef24af8-a21e-49fa-9af5-93022a2bb2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:14.735033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 308/618] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:14.761991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ece21-c577-4986-849a-d348a8975255 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:14.780337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ece21-c577-4986-849a-d348a8975255 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:14.786215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:14.787240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:14.787812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:14.788329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:14.789284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:14.790566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:14.790566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:14.790566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:14.791821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05941e-4d38-4e26-8c62-3d6f5a150a3b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:14.891943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 311/619] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:14 2022] POST /identity/v3/services => generated 251 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:15.823740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f42-bf4d-4f3d-b9a1-43c520402685 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.824817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f42-bf4d-4f3d-b9a1-43c520402685 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.825342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b5f42-bf4d-4f3d-b9a1-43c520402685 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.827593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 309/620] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:15.836684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b361e-fbfa-483d-922b-35be35e08a29 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.837656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b361e-fbfa-483d-922b-35be35e08a29 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.838144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b361e-fbfa-483d-922b-35be35e08a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.865909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bc1b361e-fbfa-483d-922b-35be35e08a29 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:15.867466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bc1b361e-fbfa-483d-922b-35be35e08a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:15.892796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 312/621] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:15 2022] POST /identity/v3/auth/tokens => generated 1171 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:15.942211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b5f42-bf4d-4f3d-b9a1-43c520402685 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:15.964824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b5f42-bf4d-4f3d-b9a1-43c520402685 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:15.969660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:15.970428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:15.970708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:15.970978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:15.971740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:15.972984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:15.972984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:15.972984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:15.973856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.024388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f3398-86d7-4625-bb22-c1cc31a4c883 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.024814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f3398-86d7-4625-bb22-c1cc31a4c883 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.025066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f3398-86d7-4625-bb22-c1cc31a4c883 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.027474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 313/622] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:16.035347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.035679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.035962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.056975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:16.058275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:16.063056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 310/623] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:15 2022] POST /identity/v3/services => generated 240 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:16.086856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 314/624] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:16 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:16.144561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.166557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5cd0-ccb3-4b7a-b676-d72beaf9ab4c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.177568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.178390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.178671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.178947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.202067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:16.209609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:16.210963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 311/625] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.218030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.233651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507f777-34d3-4f92-80a1-4f1a3cde80fc None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.243220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.244307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.244835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.245314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.247362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.251803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.256060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf668994-a7d8-4f98-8830-96b371cd786b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.263666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 315/626] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:16.270182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.276469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf56e-02fb-4a92-a7b7-0c24a74b080b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.276796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf56e-02fb-4a92-a7b7-0c24a74b080b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.277039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cf56e-02fb-4a92-a7b7-0c24a74b080b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.278950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 316/627] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:16.281138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e8fa5-cec8-4183-a82a-3bc41ab91daa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.286884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.287743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.290444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.290444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.290600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.290694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.290957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.301750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.305248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.329369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:16.330915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 312/628] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.338501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:16.340061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:16.340996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.356132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 317/629] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:16 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:16.356359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dce8c-9b15-4ac3-bf3d-26e3639f3678 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.364718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.365443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.365779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.366054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.366801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.367160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.368885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.378724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.382329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 313/630] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:16.388833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.389469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2599a-8b93-4107-97ae-59ddac11ad13 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.396128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.397012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.397293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.397568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.399408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f7f55-e721-4779-a885-f0a1c0ba0412 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.404239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.405052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.405463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.405687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.413322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:16.415458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.417524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.420771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:16.428126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 318/631] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.431503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.433450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:16.434966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 314/632] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.441385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.442369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19a33-025e-457d-b9a3-c4f06fa00d93 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.447313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.448011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.448368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.448650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.449409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.449779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.451371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a27b6-858e-4235-845b-2c81aa8add70 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.451559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.468188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 319/633] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:16.472825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.473157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.473504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.473889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.474163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.475052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.475357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.477264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.488473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0fbe-da0a-48a0-a284-94a9f65e106b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.504990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 315/634] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:16.505443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.506588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.506995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.507407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.513105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.523718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a19a99-a879-424e-9213-f373b49c1098 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.528044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.528612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.529324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.529606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.529828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.529935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.539514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.541361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.556315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 316/635] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:16.558488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.568136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:16.568326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7885-d720-4e41-b198-682667e4ac24 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.569522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 320/636] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.573308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.574153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.574435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.574712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.577462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.587420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.589775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.594599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc26-3575-47f3-ab20-82e26dc1ba07 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.610007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:16.611541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 317/637] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.614516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.615192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.615478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.615763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.616533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.617129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.618012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.618783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.628283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7114-ec06-4491-a029-5e7087eca4b3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.633512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.634162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.634476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.634764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.635492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.635847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.637542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.645565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 321/638] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:16.650817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 318/639] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:16.651846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.657005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.667281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71f06-13fc-4a1c-9c01-dea7e26eae7c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.667946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c32f-ed32-45aa-9214-d9329a553edb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.674205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.675572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.675864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.676178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.684216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.685804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.686297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.686625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.687013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.687180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.701152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:16.702753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 319/640] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:16.705310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.708161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.709945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.731371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccda6-f582-46d4-92f6-6b4d8c203605 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.737065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:16.740662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 322/641] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.741906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.742622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.742901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.743178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.744076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.744390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.746283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.748293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.760021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3116-a630-4a1b-be8f-13bbc6efb8d9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.774309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.775030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.775311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.775724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 320/642] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:16.775962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.776655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.777021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.778979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.788626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.803472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa186-11c6-4f55-8550-41d586e3c182 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.812617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.814560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.814843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.815119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.817643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=ab844b86bc184fa8b6da36559bea546e) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.817961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.821866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.830010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 323/643] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:16.832796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 321/644] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/role_assignments?user.id=ab844b86bc184fa8b6da36559bea546e&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:16.838476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.852850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590da34f-1d83-48fb-9c1e-8d1a6f6e852a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.858321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.859129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.859417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.859695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.874432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.876341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.896261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:16.897857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 324/645] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:16.910072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.920732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387557-f4f8-42de-82e0-22ede518a9d6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.929181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.929858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.930217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.930477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.931219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:16.931571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.933264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:16.952807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 322/646] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:16.961041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:16.973300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8027-a981-4501-8079-78c1bea4d2ea admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:16.979166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:16.980034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:16.980322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:16.980595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:16.990586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:16.992664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.008967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:17.010567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 325/647] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:17.018197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.029946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c334-7da7-4971-8566-8017d343cee1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.040944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.041690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.041974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.042303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.043142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:17.043504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.045503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbeac5-4f4d-469b-80f9-bb12058661da admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.067251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 323/648] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:17.074285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.087670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910c69e-2c96-4b1a-92eb-647fd2f859ea admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.093084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.094044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.094325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.094605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.097769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=77dde5aa087649f5873dc17c6fc175c5, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.100776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18da0d-d50b-45ab-af89-f91c2921a38b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.192386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 326/649] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:17 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:47:17.355103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39378d-9091-4757-b10b-435e5dac53cf None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.355474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39378d-9091-4757-b10b-435e5dac53cf None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.355664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39378d-9091-4757-b10b-435e5dac53cf None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.357497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 324/650] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:17.366465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.366825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.367117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.400983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:17.402137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:17.471424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 327/651] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:17 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:17.500571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39378d-9091-4757-b10b-435e5dac53cf None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.516855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39378d-9091-4757-b10b-435e5dac53cf None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.524559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.525354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.525638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.525914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.539459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:17.548237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:17.550322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 325/652] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:17.556718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.572006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443116-9fac-4873-8cf5-6ad1b7ae30ae None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.579927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.580856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.581852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.582286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.583256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:17.583771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.585596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.598838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 328/653] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:17.605199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.620585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ea862-bfb4-4773-bfc2-cc791bb3cc5f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.632155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.632954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.633236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.633512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.648336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.650184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.683989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:17.686214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 326/654] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:17.693459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.710841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de693321-21f3-45a5-93ad-21250dfb0715 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.722425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.723575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.724086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.724578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.725507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:17.726015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.727909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.751434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 329/655] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:17.757902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.775814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebaf5b-502e-4436-8607-884f70623caa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.787872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.789263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.789758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.790248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.810960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.813022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.835674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:17.837397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 327/656] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:17.843863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.860080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512cb9b-01f0-4526-ae89-4f49e2d59fe5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.869686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.870757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.871273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.871753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.872824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:17.873394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.875731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.908083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 330/657] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:17.912411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.923492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52780c-16cb-4d9e-a440-5e0b97d6f145 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.929920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.931011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.931501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.932042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.941973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.944179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:17.960288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 328/658] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:17.962220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:17.974019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df118a-0d3e-40f0-bcbc-7dae75fba578 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:17.980292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:17.981507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:17.982006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:17.982517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:17.995219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:17.997520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.016076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:18.022351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 331/659] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.025056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.035409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1249ee8-b900-4416-bd49-3c9cbeb878da admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.040538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.041468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.042031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.042507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.043495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.044023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.045911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.062292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 329/660] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.067147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.086161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f453d42-f067-4833-bf8f-df77ea1dc92a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.101548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.102386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.102798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.103159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.111441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.113641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.132962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:18.134617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 332/661] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.141684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.162267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ac27-6ebc-48b8-9cf6-f17faf302918 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.185024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.186104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.186600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.187066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.188520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.189074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.191569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da930dd7-96ce-42f1-983b-85cb87d0c995 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.214558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 330/662] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.222491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.239572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874977-cea7-4211-91a9-1498678ade13 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.251576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede46d-517d-4d2c-a55b-8f685112104e None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.257159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede46d-517d-4d2c-a55b-8f685112104e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.257159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede46d-517d-4d2c-a55b-8f685112104e None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.257159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 331/663] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:18.257582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.257582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.257582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.257582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.258010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=7a31cb414c8c418b96621a93ba3fff06) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.258010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.259947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.271231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 333/664] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/role_assignments?user.id=7a31cb414c8c418b96621a93ba3fff06&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.277077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af5673-e61b-475c-933a-783df8f0847e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.277309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af5673-e61b-475c-933a-783df8f0847e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.277623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af5673-e61b-475c-933a-783df8f0847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.313451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-58af5673-e61b-475c-933a-783df8f0847e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:18.314743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-58af5673-e61b-475c-933a-783df8f0847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:18.332891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 332/665] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:18 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:18.362933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.382119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616f2c-75d7-48bd-9086-53053b61cce4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.387095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.387940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.388252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.388533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.389201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.390891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.408396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:47:18.410633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 334/666] 10.222.0.79 () {56 vars in 1150 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:18.417477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af5673-e61b-475c-933a-783df8f0847e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.430990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af5673-e61b-475c-933a-783df8f0847e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.441692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.442380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.442709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.442986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.443716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.444047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.445668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.453447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 333/667] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.461774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.476281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34c10-c206-4661-a946-0753172b5e44 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.486215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.487242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.487711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.488382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.489365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.489872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.491692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.506219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 335/668] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.512618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.529335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7288a6-db06-4925-8071-5efb7c00b367 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.538543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.539203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.539483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.539753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.540581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] RBAC: Adding query filter params (interface=public, service_id=3a0a1e669a9747aca1eb00cd3e655051, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:18.540891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.541902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:18.541902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:18.541902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:18.542780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c081e9-9207-47a3-86a7-474b6d0ce203 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.559564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 334/669] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/endpoints?service_id=3a0a1e669a9747aca1eb00cd3e655051&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:18.566455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:18.579921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b084b5-a822-427b-898d-cf00b02e608f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:18.588745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:18.590029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:18.590531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:18.591017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:18.591991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:18.593995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077217d-2f38-4e2c-90e6-0c70c39b4e23 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:18.605457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 336/670] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:18 2022] GET /identity/v3/services => generated 772 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:19.176999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94172a-e149-426d-b888-f308f06712b4 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.177519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94172a-e149-426d-b888-f308f06712b4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.177519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94172a-e149-426d-b888-f308f06712b4 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.179598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 335/671] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:19.189333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.191031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.191757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.225148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:19.226748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:19.241746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 337/672] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:19 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:19.283510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94172a-e149-426d-b888-f308f06712b4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.304725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94172a-e149-426d-b888-f308f06712b4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.309788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.310877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.311374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.311862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] PATH_INFO: `/v3/services/network` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.312752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.314631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.330232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:47:19.332185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 336/673] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/services/network => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:19.339844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.353698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd6abf-3933-4e32-aa79-a3e137ffd9b8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.361439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.363185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.363712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.364234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.365154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:19.365658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.367554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.376994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 338/674] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:19.385419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.401139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c1473-d97a-4bd4-9848-7dbb3e77e68b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.407419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.408495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.409618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.410166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.411153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:19.411658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.413553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.421173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 337/675] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:19.428618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.441497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebfa3f-3f12-4d0c-ba64-d402fd4f8de3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.452609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.453361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.453650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.453931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.454886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] RBAC: Adding query filter params (interface=public, service_id=bb0817ecc08342f2bc0e222ee0efd1cc, region_id=RegionOne) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:19.455230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.456506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:19.456506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:19.456506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:19.457519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21bc25-f480-4878-ae23-d7b269cc5d74 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.478386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 339/676] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/endpoints?service_id=bb0817ecc08342f2bc0e222ee0efd1cc&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:19.484084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.504513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e3ab1-67b0-440e-8f79-da0064f53748 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.517491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.518556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.519036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.519509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.520424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.522215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229f588-1d65-4ba7-9abb-28d95f301bb4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.532819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 338/677] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/services => generated 772 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:19.735000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fa67-d1ab-45e4-836b-3f651b12818b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.735401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fa67-d1ab-45e4-836b-3f651b12818b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.735575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763fa67-d1ab-45e4-836b-3f651b12818b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.737948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 340/678] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:19.745489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.746095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.746584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.782270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:19.783886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:19.805807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 339/679] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:19 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jan 28 01:47:19.843263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763fa67-d1ab-45e4-836b-3f651b12818b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.863779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763fa67-d1ab-45e4-836b-3f651b12818b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.870061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.870970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.871258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.871540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.887920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:19.895442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:19.897069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 341/680] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:19.903295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.918328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e4b0e-82e4-4b1d-8b70-3b7f87fd751e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.923249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.923941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.924437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.924754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.925590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:19.925893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.927650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:19.942759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 340/681] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:19.947672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:19.958882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdcc2c-8ba2-48e2-a4f6-08e70b87ec35 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:19.965627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:19.966477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:19.966811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:19.967082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:19.979104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:19.981231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.005438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b407b075-26a4-488e-aac2-985a474d47d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:20.006568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 342/682] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.012875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.026615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdebd3-752c-4399-8394-191c3fa1e62e None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.026894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdebd3-752c-4399-8394-191c3fa1e62e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.027163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdebd3-752c-4399-8394-191c3fa1e62e None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.029135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 343/683] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:20.029396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188ee8-9c18-4179-9b8c-a11e02550622 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.036974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.037306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.037634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.037735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.037904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.037993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.038182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.039002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.039320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.040935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.057689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:20.058887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:20.066913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 341/684] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.067191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 344/685] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:20 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:20.073067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.089472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e1aee-17cf-4442-8e19-7e12ba3d8622 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.105177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.106044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.106339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.106612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.111426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.120068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.122084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.127335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd026-5b81-4f89-b24b-44fcd9189dcc None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.155678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:20.157374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.158166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.158449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.158719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.166890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 342/686] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.175600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.182361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:20.193595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:20.196504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d1f1-700b-4a55-9b7d-6295a8391b1f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.199672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 345/687] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:20.203293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.204370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.204875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.206199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.210201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.211342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.212444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.215995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.223036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f88fb-ccb8-4198-8cb6-aabbb40ad751 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.234203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.235370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.236515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.237073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.240789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.241308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.243142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.257045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 343/688] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.266144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 346/689] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:20.269207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.272298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.285306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e205-e39f-4a35-a3c9-af380205259a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.289942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.290784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.298111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.298111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.298358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0942f16-e11b-44d6-b0f5-50bd27cdaa54 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.306217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.306770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.307568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.309673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.310418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.310698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.331750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.333869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.338284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:20.340349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 344/690] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.346572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.361582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:20.363139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 347/691] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.365639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f25f2-6289-4a52-acfb-63d5e9249c52 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.369200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.377964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.380636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.380918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.381188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.383679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.384018 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.385611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.386739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967e3e-005e-44b8-ba5b-525e542cafd2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.395344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.396024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.398137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.398412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.400905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.401217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.403582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.412023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 345/692] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:20.417945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.429857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 348/693] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:20.431885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2861b7-2ed6-4573-b015-75cc5f77e435 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.434492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.444930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.446857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.447150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.449229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.451879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19c11-c2b2-4708-8980-4109fd540101 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.461314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.461913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.462200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.462479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.462747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.464166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.479392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.479844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:20.481435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.481642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 346/694] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.488014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.495418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:20.496999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 349/695] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:20.503565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.510968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407dc04-0497-4e26-aa54-eb2517889a29 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.517818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f57b-d646-4b03-906f-6496359764df admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.522196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.522853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.523133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.523403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.524220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.524524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.526348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.532459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.533118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.533391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.533659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.535049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.535353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.537194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.554819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 347/696] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:20.559026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.569908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 350/697] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.576971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.585134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2fb99-f691-42ca-b0ff-af593b0c9d6c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.594544 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.596530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300da49b-eeb1-4a51-ad7e-22cbfd8676d7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.597225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.597460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.597737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/ab844b86bc184fa8b6da36559bea546e/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.608622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.609268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.609550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.611237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.625663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=ab844b86bc184fa8b6da36559bea546e, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.627059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.628999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.635249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.639108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 351/698] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/auth/tokens => generated 1270 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:20.647711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.655908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a9ab1-fd88-4610-9c77-f87f84c210a7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.661498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.662388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.662739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.663059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.674817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.677119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.695500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:20.697104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 352/699] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:20.705268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 348/700] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:20 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/ab844b86bc184fa8b6da36559bea546e/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:20.706848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.717758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796010-cf5d-4c1f-a901-b179eacef222 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.793807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.794461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.794744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.795071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.795817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.796150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.797881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.811121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 353/701] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.821250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.838537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bd32e-f4f7-4268-bbbe-8599f74b9f92 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.845067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.845940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.846225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.846620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.860326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.862429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.883155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-03d9f182-3218-4005-bcc3-e3d36a1dec57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:20.884683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 349/702] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:20.891056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.902208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c004-ac8c-4fd3-ac99-07a4b02e20eb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.907229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.908139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.908469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.908752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.909672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.909988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.911904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7c36a-c246-4ba8-a1b5-07b4970b5e5c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.924057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab975-eb69-455f-a355-454f3dd85323 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.924482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab975-eb69-455f-a355-454f3dd85323 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.924734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab975-eb69-455f-a355-454f3dd85323 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.926598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 350/703] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:20.931413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 354/704] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:20.938533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab975-eb69-455f-a355-454f3dd85323 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:20.948270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.950171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.950171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.958903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab975-eb69-455f-a355-454f3dd85323 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:20.969605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:20.972414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:20.972752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:20.973032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:20.973943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:20.974266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:20.978062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:20.990368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:20.990368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:20.990823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 351/705] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:20 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.002725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 355/706] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:20 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:21.027863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.039034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539b304-1f4c-45f9-a22a-a3a1c0e12ffc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.048534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.049301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.049646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.049920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.062860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:21.070084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:21.071718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 352/707] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.078637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.093929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72cc80-8bd2-4abd-b39a-5e9f1d3cc140 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.103338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.104127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.104422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.104698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.105514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.105873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.107659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.123577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 356/708] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.130896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.146295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789696e-dd96-4908-b86d-357e3071e460 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.162422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.163226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.163510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.163788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.180095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.181974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.207749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:21.209043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 353/709] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.216495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.233473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80481d-9245-466a-87d8-7f3f9ba28471 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.245455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.246484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.246957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.247451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.248403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.248899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.250717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.267043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 357/710] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.274443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.290626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190f589-8a13-42d6-bc3f-76128234de72 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.300727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.301757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.302190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.302646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.311755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.314006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.329600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:21.332028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 354/711] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.339238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.352691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873be071-ee45-4f0f-86b2-d6de3640f32e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.358247 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.359044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.359386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.359724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.360696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.361137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.363625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.387330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 358/712] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.390347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.401934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a45c1-fbd4-490e-b42b-96e3ab4b569c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.407359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.408232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.408563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.408951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.422655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.424653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.442352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:21.446683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 355/713] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:21.450368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.461671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845e52-e599-4192-8273-1a9055bd2af9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.466633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.467341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.467626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.467899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.468705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.469009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.470698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.488102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 359/714] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.490097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.500128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fef03-9bdf-4626-9807-f8473f32ffa3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.509062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.509911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.510187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.510510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.519207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.521434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.538262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:21.539740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 356/715] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.546088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.556621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd63dc-6409-4d47-8561-557ad2374aa2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.561142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.561845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.562124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.562399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.563229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.563536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.566298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05688c58-3f9c-484b-b0d4-ad7b5a6fcf77 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.584083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 360/716] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.589672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.605214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795037e7-972b-4df1-baa6-1fb380147479 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.616758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.617666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.617945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.618223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/7a31cb414c8c418b96621a93ba3fff06/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.620549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=7a31cb414c8c418b96621a93ba3fff06, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.623224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960d2e2-b515-4e1d-8189-c2922e833584 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.708537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 357/717] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:21 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/7a31cb414c8c418b96621a93ba3fff06/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:21.725561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc34c-171e-493e-b42d-f582e3ee4885 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.725979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc34c-171e-493e-b42d-f582e3ee4885 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.726216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc34c-171e-493e-b42d-f582e3ee4885 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.728369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 361/718] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:21.736614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958653-e540-4843-bbcc-910c22ce436b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.736925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958653-e540-4843-bbcc-910c22ce436b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.737213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69958653-e540-4843-bbcc-910c22ce436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.758312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-69958653-e540-4843-bbcc-910c22ce436b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:21.759540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-69958653-e540-4843-bbcc-910c22ce436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:21.841103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 358/719] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:21 2022] POST /identity/v3/auth/tokens => generated 1270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:21.866423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc34c-171e-493e-b42d-f582e3ee4885 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.880103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc34c-171e-493e-b42d-f582e3ee4885 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.884871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.885749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.886028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.886356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.887020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.888736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.905528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:47:21.907114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 362/720] 10.222.0.79 () {56 vars in 1150 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:21.914002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69958653-e540-4843-bbcc-910c22ce436b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.924059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69958653-e540-4843-bbcc-910c22ce436b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.931408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.932084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.932373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.932649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.933368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.933679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.935295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.941334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 359/721] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.949429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:21.959666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eddda1-9141-4e2f-b4c4-55d5c713c41e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:21.968527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:21.969513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:21.970065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:21.970555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:21.971546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:21.972275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:21.974229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a733e-dea7-4fa3-b6ab-0e7a5961ed90 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:21.980189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 363/722] 10.222.0.79 () {56 vars in 1145 bytes} [Fri Jan 28 01:47:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:21.986298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:22.001048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39920e-dd07-48f5-b8f2-ba196489c184 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:22.012718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:22.013398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.013688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.013968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.014740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:22.015758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:22.015758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:47:22.015758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:47:22.016690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce6886-7f69-456f-b069-a3458c59492b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:22.125801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 360/723] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:22.430044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40ec6-ff81-455a-a402-93c165a72556 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.430574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40ec6-ff81-455a-a402-93c165a72556 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.430574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40ec6-ff81-455a-a402-93c165a72556 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.432690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 364/724] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:22.440357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.440844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.441008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.460661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:22.461867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:22.493081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 361/725] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:22 2022] POST /identity/v3/auth/tokens => generated 1456 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:22.516728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40ec6-ff81-455a-a402-93c165a72556 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:22.529375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40ec6-ff81-455a-a402-93c165a72556 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:22.534284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:22.535271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.535551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.535818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.536504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:22.538096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:22.550551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:47:22.552098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 365/726] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:22 2022] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:22.559332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:22.568792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dfb3f-2919-433e-94a8-9d85554a6905 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:22.573277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:22.573937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.574214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.574496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.575212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:22.575517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:22.577183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:22.583944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 362/727] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:22.590385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:22.604871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8fd13-b53b-4584-9e1d-8b426b4eddb9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:22.609533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:22.610251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.610655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.611012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.611781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:22.612205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:22.613865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93965a9-4057-40e9-aa7e-64ad6cac3f32 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:22.623813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 366/728] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:22.630254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:22.645640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e2436-cbb5-457e-a3e3-07ac35d5c889 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:22.650617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:22.651635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:22.652116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:22.652687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:22.653665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:22.661739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4aaa0-d651-4b67-88ce-b1fe2edca136 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:22.800214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 363/729] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:23.581897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369792c8-83f7-44f5-a4fd-a93824180337 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.582904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369792c8-83f7-44f5-a4fd-a93824180337 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.583399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369792c8-83f7-44f5-a4fd-a93824180337 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.585795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 367/730] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:23.593384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.593852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.593924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.612648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:23.613855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:23.631012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 364/731] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:23 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:23.655989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369792c8-83f7-44f5-a4fd-a93824180337 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.669719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369792c8-83f7-44f5-a4fd-a93824180337 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.674767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.675748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.676060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.676338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.688538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:23.696093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:47:23.697591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 368/732] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:23.704016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.715132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7721e1-5a35-4aa6-80a3-f2b42ec0926b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.720001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.720667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.720955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.721262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.722028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:23.722339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.723949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.733398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 365/733] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:23.739660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.749683 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068a35f-ba79-4a91-a635-87202eb9fb07 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.754967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.755751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.756148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.756331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.768143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.770537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.787680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:23.789229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 369/734] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:23.795355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.805587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11f2ec-d9dd-47ac-a237-7754d5b26310 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.810216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.810881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.811165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.811444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.812213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:23.812521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.814124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.827704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 366/735] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:23.834478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.844611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c9314-b833-46a3-8bbb-8cb15b2d65e4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.849360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.850157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.850439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.850717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.859415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.861491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.876596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:23.878787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 370/736] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:23.885139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.899516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a57367-34fd-4369-8432-f6b3de6f41f0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.904910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.905822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.906356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.906806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.907868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:23.908395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.910563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.929792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 367/737] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:23.936198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:23.947385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f857-3924-4dc1-b2de-df7ad4c5ed47 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:23.952673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:23.953573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:23.954062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:23.954517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:23.964827 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:23.966896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:23.978411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 371/738] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/auth/tokens => generated 1605 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:23.990108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.002139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9556fc-50e2-44b2-af85-1f9132961175 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.007878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.009018 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.009574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.010050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.022698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.024887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.047246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-f96b8297-01f4-4ced-bedb-a0b7aac21e97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:24.048883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 368/739] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.055413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.065138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd33665-30ee-481d-ae19-919c94f8a74b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.070382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.071298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.071783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.072315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.073233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.073755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.075551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.090308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 372/740] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.090605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07ded-d79c-438b-8d30-73aaf4304cdf None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.095556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07ded-d79c-438b-8d30-73aaf4304cdf None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.095556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed07ded-d79c-438b-8d30-73aaf4304cdf None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.095556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 369/741] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:24.097703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.101352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.101644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.101926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.109065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af778f34-1239-4569-8075-89d4c2357f9b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.114794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.115934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.116472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.116947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.121767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:24.122997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:24.125820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.129179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.144341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 370/742] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:24 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:24.155962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:24.158229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 373/743] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.164679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.165761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.175396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf668fa0-c0cf-49e6-ba95-426f255746bc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.177634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9dbf9-a4d8-40af-a172-47425bec3462 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.180446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.181152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.181449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.181711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.182591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.182903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.184210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.184949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.185456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.185936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.186436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.187344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.189147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.198975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 371/744] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.201876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:47:24.203527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 374/745] 10.222.0.79 () {56 vars in 1153 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:24.209280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.211533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.221850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215dd2c-ca68-4230-a657-e33ba441254d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.225716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd866d7e-888f-4e5d-a5c5-e6deca0985a4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.227250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.228020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.228362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.228643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.229694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=ab844b86bc184fa8b6da36559bea546e) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.230012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.231274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.231857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6913-908b-4d37-b80b-d7a8379c09cd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.232035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.232238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.232519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.233223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.233532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.235101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699d11c-50cb-484d-add3-28a2d1f892bd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.238932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 372/746] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/role_assignments?user.id=ab844b86bc184fa8b6da36559bea546e&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.240540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a49a0-b2a5-4de6-b82c-fc203c4bb328 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.241014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a49a0-b2a5-4de6-b82c-fc203c4bb328 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.241461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a49a0-b2a5-4de6-b82c-fc203c4bb328 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.243588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 373/747] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:24.245499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 375/748] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.246518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a49a0-b2a5-4de6-b82c-fc203c4bb328 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.252101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.252689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.253299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.269928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a49a0-b2a5-4de6-b82c-fc203c4bb328 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.274945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.275811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.276216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.276568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.277392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.277773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.279515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.287842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:24.289587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:24.292419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 374/749] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.300447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 376/750] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:24 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:24.326921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.340161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb3c0-3e4a-4685-b1e4-6173a230b481 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.345569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.346456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.347022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.347564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.362282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:24.369606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:24.371322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 375/751] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:24.378993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.390190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc744-d050-4eaf-acff-49c39adc543f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.395940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.396899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.397361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.397812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.398769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.399217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.401056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.411937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 377/752] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.419137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.435301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff7057-818b-430b-a4ca-6ef221df4f94 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.441113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.442233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.442595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.442957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.455487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.458204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.478948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:24.480625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 376/753] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.487475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.499047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875c3d7-1b83-4056-b0e3-eb7f80c56b08 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.506419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.507243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.507243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.507494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.508222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.508603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.510309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.525688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 378/754] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.532304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.544021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd7406-3bcc-4aee-8e90-17920ad085a5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.551646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.552821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.553179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.553569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.562188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.564430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.579330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:47:24.581165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 377/755] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.587741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.599882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0396050-79f1-4a3e-8420-cbf250225f40 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.605446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.606364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.606909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.607363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.608390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.608864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.611025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.631738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 379/756] 10.222.0.79 () {56 vars in 1156 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.638434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.649457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524c8b-f448-477a-943c-b5389bbe92fd admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.654683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.655546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.656014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.656432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.666757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.668924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.680832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 378/757] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:24.687745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.699089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840349-aa01-44c6-99a9-943c3864fb31 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.704436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.705494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.706006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.706501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.719381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.722097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.740834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-2a34e01e-1eed-4f2d-ac85-215c41f38c27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:24.742620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 380/758] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.749065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.759286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c691a4c-3741-47ec-aacf-500dc44fc179 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.764258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.765185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.765617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.766064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.766934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.767386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.769901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.772601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11da7-4341-4d61-a9a4-b148a8f2239e None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.773128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11da7-4341-4d61-a9a4-b148a8f2239e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.773554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11da7-4341-4d61-a9a4-b148a8f2239e None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.775779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 381/759] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:24.785188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.785527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 379/760] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.785864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.786308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.791573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.801308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dace254-e892-4caa-be6a-1ff383631f23 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.806098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.806693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:24.806877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.807153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.807426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.808638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:24.814587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.817151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.818391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 382/761] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:24 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:24.831629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:24.838446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 380/762] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:24.840141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.845703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.850929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc728-f988-4db2-b7d2-6b841ea93863 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.855676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef452dc-2a24-4a27-b77f-c4bf3541440f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.856236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.857088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.857690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.858336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.859940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.860438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.860809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.862252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.862814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.863313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.863626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.864135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.865889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.876713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 383/763] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.880994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:47:24.882632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 381/764] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:24.889652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.889875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.900569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710602-8a34-476b-b524-56b8134c57a9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.900873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e79ec-d83a-4522-8e4c-0b50e81b6779 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.905453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.905608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.906331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.906536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.906796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.907112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.907231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.907622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.908192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.908590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.909089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=7a31cb414c8c418b96621a93ba3fff06) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.909561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.910795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.911700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a86e47-e79d-4cf3-9ed1-4f147973536c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.915794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 382/765] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.919162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 384/766] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/role_assignments?user.id=7a31cb414c8c418b96621a93ba3fff06&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:24.924015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:24.933321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc53b3-63d2-46ad-bb9f-c78407f2313b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:24.938542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:24.939518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:24.939955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:24.940886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:24.941934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:24.942381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:24.944240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9bd80-6b60-4391-80ac-9bfb977b2618 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:24.956198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 383/767] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:26.745580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec8ba-0eef-43a9-87a6-efc6f824b106 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.746119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec8ba-0eef-43a9-87a6-efc6f824b106 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.746119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ec8ba-0eef-43a9-87a6-efc6f824b106 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.748568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 385/768] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:26.757801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904e3b3-2001-4efa-ad13-a1c97e691774 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.758465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904e3b3-2001-4efa-ad13-a1c97e691774 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.758465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904e3b3-2001-4efa-ad13-a1c97e691774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.779896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4904e3b3-2001-4efa-ad13-a1c97e691774 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:26.781438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4904e3b3-2001-4efa-ad13-a1c97e691774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:26.791006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 384/769] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:26 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:26.817276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ec8ba-0eef-43a9-87a6-efc6f824b106 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:26.830522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ec8ba-0eef-43a9-87a6-efc6f824b106 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:26.836022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:26.836974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.837309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.837635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.852571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:26.860317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dde6a-f059-467d-b6ba-0ca0d26a774e None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.860711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dde6a-f059-467d-b6ba-0ca0d26a774e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.860875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dde6a-f059-467d-b6ba-0ca0d26a774e None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.861794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9aadd363-b3b9-4bde-b1de-e7f11da6e962 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:26.863964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 386/771] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:26.864191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 385/771] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:26.871145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.871499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.871738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.873303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dde6a-f059-467d-b6ba-0ca0d26a774e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:26.891215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dde6a-f059-467d-b6ba-0ca0d26a774e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:26.893965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:26.896457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:26.897900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:26.898808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.899147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.899483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.900363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:26.900749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:26.902426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:26.909254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 387/772] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:26 2022] POST /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:26.912191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 386/773] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:26.918566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:26.929040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1481-0d95-443b-b05c-7b1d1477dc14 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:26.933690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:26.934592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:26.935404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.935704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.936041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.946877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac71012-7e0b-4ea1-bcbd-30528caeeaa2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:26.951456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:26.952483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:26.953403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:26.953712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:26.954057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:26.954669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:26.956184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:26.958055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:26.984174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:26.986482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 388/774] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:26.992764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.004755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7da99-54cd-467f-a740-114d6fbd238f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.010653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.011561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.011846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.012163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.012902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.013209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.014921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.031372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 389/775] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:27.037914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.050872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23addba5-ba39-41d1-a06c-d3cb433b6055 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.056703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.057654 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.057946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.058240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.076012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.076012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.076384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 387/776] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:26 2022] POST /identity/v3/services => generated 269 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:27.109620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:27.113412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 390/777] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:27.120740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.155192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239216f4-8f60-4a6a-9a42-738988a9a1d5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.160520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.161202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.161479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.161756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.162609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.162984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.165115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.187256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 388/778] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:27.194577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.205625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5081af2-5953-43d6-866f-4228478f4def admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.210786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.211463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.211743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.212056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.224543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.228595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.249239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 391/779] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/auth/tokens => generated 1715 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:27.257725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.268042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a594-bc9c-4603-8f53-d994c0024e3d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.273347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.274154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.274441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.274718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.287327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.289428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.310562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-26ff7a5a-325b-4584-9c00-bbf08c17a0b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:27.316483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 389/780] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:27.320090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.336369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c73e86-3211-44c1-a939-4a7d21bad4fb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.337701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76aa8e-afd7-4cc5-8431-011fb8357220 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.337992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76aa8e-afd7-4cc5-8431-011fb8357220 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.338271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76aa8e-afd7-4cc5-8431-011fb8357220 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.340521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 390/781] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:27.349149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.349594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.350062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.350439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.351108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.351431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.351721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.352583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.352889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.354489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.369304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 392/782] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:27.369681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:27.370918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:27.376301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.380741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 391/783] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:27 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:27.387721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa47df0-719d-41aa-bb22-de5990aad70c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.395391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.396587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.397077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.397596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.407403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.407857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.411804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.421564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f188bf-3f48-4ec0-be51-8d54022a33ea None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.427904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:27.428140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.428983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.429465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.429700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 393/784] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:27.432392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.433354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.435387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.437240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.449703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e346fa-9ae1-41fd-a863-457906b62f3a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.451885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:47:27.454090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 392/785] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:27.456754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.457686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.458172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.458661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.459643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.460265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.461858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.465601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.472966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69ebc-1bf4-473f-bd25-93bb35362c39 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.478895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.479555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.479837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.480175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.480884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.481195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.481967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 394/786] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:27.482848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.488282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 393/787] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:27.488669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.495186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.503355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c047-f061-496d-bdfc-d7feff3b8a35 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.506115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf520-ef2e-49a4-a4d3-292c09cc5319 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.509581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.510679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.510943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.511438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.511640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.512148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.512148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.512380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.512865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.513172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.513277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] RBAC: Adding query filter params (role.id=9573db05e12e4a6a81e19ca501fc627c, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=ab844b86bc184fa8b6da36559bea546e) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:27.513490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.514798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b113a9-1fbe-4355-b9ba-b25d504be998 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.515341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4263c3d-f3ea-4512-8acf-cae7c853e94b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.521577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 394/788] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:27.522415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 395/789] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:27 2022] GET /identity/v3/role_assignments?user.id=ab844b86bc184fa8b6da36559bea546e&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=9573db05e12e4a6a81e19ca501fc627c => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:27.522871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d62e-a54d-41d6-8c55-ab13c1bb42c5 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.523160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d62e-a54d-41d6-8c55-ab13c1bb42c5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.523437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d62e-a54d-41d6-8c55-ab13c1bb42c5 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.528747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 395/790] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:27.538439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899784-01d8-4193-a273-6b0c126c784f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.539156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899784-01d8-4193-a273-6b0c126c784f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.539799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899784-01d8-4193-a273-6b0c126c784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.561500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-29899784-01d8-4193-a273-6b0c126c784f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:27.563092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-29899784-01d8-4193-a273-6b0c126c784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:27.574093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 396/791] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:27 2022] POST /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:27.602671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d62e-a54d-41d6-8c55-ab13c1bb42c5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:27.620410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d62e-a54d-41d6-8c55-ab13c1bb42c5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:27.626024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:27.627706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:27.629325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:27.629926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:27.631077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:27.633248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f5c70-4adf-45e2-9bf2-d71511e1b2ad admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:27.727435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 396/792] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:27 2022] POST /identity/v3/services => generated 251 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:29.530488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25e8e-b4df-46e3-9a2c-70f691940218 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.531006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25e8e-b4df-46e3-9a2c-70f691940218 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.531082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e25e8e-b4df-46e3-9a2c-70f691940218 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.533187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 397/793] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:29.541750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.542230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.542303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.560699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:29.561897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:29.584090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 397/794] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:29 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:29.604828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e25e8e-b4df-46e3-9a2c-70f691940218 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.618038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e25e8e-b4df-46e3-9a2c-70f691940218 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.622564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.623359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.623642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.623918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.624608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.626205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.638583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:47:29.644128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 398/795] 10.222.0.79 () {56 vars in 1153 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:29.647524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.657011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b429a2-f4e7-4a37-be16-b5a092a84866 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.662233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.662894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.663179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.663459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.664219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:29.664530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.666118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.676090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 398/796] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:29.677795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.688059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed339-2bde-4074-86aa-53f4d5062a69 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.693439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.694123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.694404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.694681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.695416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:29.695725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.697423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.703661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 399/797] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:29.711049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.723536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa417852-b0ed-4dfb-aede-044cb3d76488 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.728465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.729223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.729509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.729787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.730603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] RBAC: Adding query filter params (interface=public, service_id=6d418cdbd8194b2581bc83e6c7f12cea, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:29.730914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.732603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32136620-9437-46b0-90da-b5a1fb42b384 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.744116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 399/798] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/endpoints?service_id=6d418cdbd8194b2581bc83e6c7f12cea&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:29.745562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.758426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c04e53-77a3-44f1-a0aa-90aaf05f7e1d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.763798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.764914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.765386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.765843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.766892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.770280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de60c60-9eec-415e-a116-8dddce96ff21 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.784231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 400/799] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/services => generated 1268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:47:29.810340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752735ed-db6d-4ac3-8ccc-673c03f8bbe8 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.810624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752735ed-db6d-4ac3-8ccc-673c03f8bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.810905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752735ed-db6d-4ac3-8ccc-673c03f8bbe8 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.813259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 400/800] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:29.822201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3c72-5a6a-4922-9b1c-31bfe865bc65 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.822500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3c72-5a6a-4922-9b1c-31bfe865bc65 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.822761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3c72-5a6a-4922-9b1c-31bfe865bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.843110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-87de3c72-5a6a-4922-9b1c-31bfe865bc65 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:29.844444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-87de3c72-5a6a-4922-9b1c-31bfe865bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:29.853202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 401/801] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:29 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:29.865572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dff57-1d4d-44eb-bb74-63c903138be0 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.865872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dff57-1d4d-44eb-bb74-63c903138be0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.866165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dff57-1d4d-44eb-bb74-63c903138be0 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.868515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 401/802] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:29.876606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.876914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.877701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.879464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dff57-1d4d-44eb-bb74-63c903138be0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.892558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dff57-1d4d-44eb-bb74-63c903138be0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.898471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.899300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.899583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.899686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:29.899860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.900872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:29.911031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 402/803] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:29 2022] POST /identity/v3/auth/tokens => generated 1816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:29.918482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:29.927029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:29.928653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 402/804] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:29.935110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.942394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.946065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb84c-5c64-401d-805d-6d5f4e72f3a8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.952071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.952895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.953183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.953462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.954477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:29.954786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.956617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432bc8d-6b48-4172-8fb1-404e41fc5d02 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.957286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.963540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.964443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.965228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.965518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:29.966365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:29.968144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804fb5-1bf3-489a-a20c-599db19f4da5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:29.969558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 403/805] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:29.977425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:29.988800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfecdd-f385-43c4-9fc1-37af85d38872 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:29.993796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:29.994655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:29.994942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:29.995218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.008026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.010198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.029987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:30.031394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 404/806] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:30.038567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.048487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 403/807] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:29 2022] POST /identity/v3/services => generated 241 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:30.056675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b2a6-d433-4035-89b1-e535d3cbcab6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.063877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266de4-79be-4b3c-aa85-a00abc136c1d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.064197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266de4-79be-4b3c-aa85-a00abc136c1d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.064477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266de4-79be-4b3c-aa85-a00abc136c1d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.067329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 404/808] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:30.075516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.077037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.077037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.081230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.082132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.082557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.083126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.084189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.084681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.086396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.097350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:30.098580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:30.101340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 405/809] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:30.110615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 405/810] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:30 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:30.113019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.123769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c1f5c-a7db-4b6f-9f43-650f5d064685 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.135120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.136108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.136400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.136680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.138785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.149412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4b86-4f29-41fe-b31e-af6da9efd098 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.152255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.154508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.154631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.155529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.155807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.156136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.156854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.159066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.171012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:47:30.171777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:30.173354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 406/812] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:30.176263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 406/812] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:30.180778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.181174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.192086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294162e0-dec0-48df-a88f-c37facc9e732 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.192692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a97ea-f1c3-4f86-8e59-c5431d31548e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.197923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.198247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.198601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.198885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.199059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.199209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.199393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.199550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.200015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.200232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.200385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.200524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.202211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.202396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.212189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 407/813] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:30.215524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.226545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 407/814] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:30.226865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac6bf-4a13-4043-a6cc-384bd88407f9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.233134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.235053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.235773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.236100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.237002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.237991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.238417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.240187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.245194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e76b73-7617-4347-a232-fda4d5389558 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.246284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 408/815] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:30.253680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.259143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.259143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.259143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.259143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.267873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cd0ad-ba25-46e7-9093-0c1efafdecb6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.270878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.272857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.274487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.275067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.275350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.275619 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.276496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] RBAC: Adding query filter params (interface=public, service_id=665b8b63ba9a48e997ee2cc6fedcf236, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.276805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.278419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.285463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 409/816] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/endpoints?service_id=665b8b63ba9a48e997ee2cc6fedcf236&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:30.292148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.292317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:30.293669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 408/817] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:30.301358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.304830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127e53-85af-417a-9558-4e6c969f6d56 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.309736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.310497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.310815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.311138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.311820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.313219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff07812-ef46-447e-802f-89500ef0a2bb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.313601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.318892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.319550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.319832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.320143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.320855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.321162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.322251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 410/818] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:47:30.322942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.337128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 409/819] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:30.343841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.359782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4abb0d-d0c1-4371-ad8a-e6e7f3d684d7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.366194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.367259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.367736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.368212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.378134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.381096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.396407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:30.398380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 411/820] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:30.405289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.416381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8fdf-57d7-4e82-96c6-bcf44b1890b8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.421747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.422701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.423133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.423551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.425614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:30.426192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.428486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a202-15ca-484f-b052-4ac9f9db3303 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.447844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 410/821] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:30.451352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:30.462702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c6296-60ac-4a52-aff4-ec29cac00ac8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:30.468317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:30.469486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:30.470024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:30.470597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/ab844b86bc184fa8b6da36559bea546e/roles/9573db05e12e4a6a81e19ca501fc627c` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:30.474364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=ab844b86bc184fa8b6da36559bea546e, role_id=9573db05e12e4a6a81e19ca501fc627c)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:30.477406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471d450-d357-4a09-97e1-8901d0304609 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:30.552782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 412/822] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:30 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/ab844b86bc184fa8b6da36559bea546e/roles/9573db05e12e4a6a81e19ca501fc627c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:32.099253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c04a-7c73-41d1-bafa-399a0788708d None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.099806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c04a-7c73-41d1-bafa-399a0788708d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.099806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c04a-7c73-41d1-bafa-399a0788708d None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.101814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 411/823] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:32.109810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.110287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.110387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.129350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:32.132761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:32.193058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 413/824] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:32 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:32.217598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c04a-7c73-41d1-bafa-399a0788708d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.231096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c04a-7c73-41d1-bafa-399a0788708d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.235557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.236587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.237002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.237285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.237950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.239541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.253031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:47:32.254470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 412/825] 10.222.0.79 () {56 vars in 1153 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:32.261312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.271717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86c51-c4b9-4765-8596-2a83a0ca7b96 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.276484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.277144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.277596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.277873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.278596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.278909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.280532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.286500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 414/826] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.293440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.303340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a72cab-33d6-4e20-80c5-af1b4752fd71 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.308086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.308781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.309029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.309306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.310021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.310326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.311919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e97718-a642-4aed-93c4-4b3fbe5e71a3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.319084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 413/827] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.325506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.339878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0b19-fd3a-4f23-861c-82a2486bc777 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.347587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.348709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.349015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.349354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.350083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.351726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.451333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caf06c-5069-408b-8b20-325a7d2ace97 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.451623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caf06c-5069-408b-8b20-325a7d2ace97 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.452054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caf06c-5069-408b-8b20-325a7d2ace97 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.453823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 414/828] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:32.461441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.461731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.462002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.481412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:32.482627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:32.496287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 415/829] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:32 2022] POST /identity/v3/auth/tokens => generated 1918 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:32.505491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 415/830] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:32.520731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.535670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7117b4a-f0d4-4722-8f50-019c8160d837 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.555824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.557143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.557710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.558201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.559127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.561073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.581741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:47:32.585129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 416/831] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:32.592186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.604485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fde71-bb8a-490a-93b1-805773fd05a6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.610878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.612654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.613156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.613787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.614766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.615075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.616782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.623547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 416/832] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.633564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.649342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfbaed-eb7e-4428-be37-903fa77baff7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.656424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.657209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.657639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.658000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.659101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.659621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.662419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b557e5c-7cc2-4d95-9018-8ab2f0cf238b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.671099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 417/833] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.683956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.699111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f35f8-31ea-47a1-b5f3-d214c94ac178 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.699363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c8c72-6e7e-46bc-86a8-d9081e243fe1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.699678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f35f8-31ea-47a1-b5f3-d214c94ac178 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.700175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f35f8-31ea-47a1-b5f3-d214c94ac178 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.704060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 418/834] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:32.707685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.714490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.714490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.714490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.714490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] RBAC: Adding query filter params (interface=public, service_id=efab79b09e1846008275252a4b819556, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.714963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.715059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.715142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.715142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.715284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.725633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 417/835] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/endpoints?service_id=efab79b09e1846008275252a4b819556&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.737236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.742285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:32.743685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:32.749282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37fdc3-263c-4ede-9cc5-946fcec29038 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.755162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.755521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 419/836] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:32 2022] POST /identity/v3/auth/tokens => generated 2105 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:32.761216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.761942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.762580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.763664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.767325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.777518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 418/837] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services => generated 1497 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:47:32.780364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.792854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67499-247b-416a-865a-accf781ae9a1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.797838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.798651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.799719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.802697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.802697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.802697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.819115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:47:32.823354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 420/838] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:32.832934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.849808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93a48f-b3ff-4796-b2b0-679d3d1c9723 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.857483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.858495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.858970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.859364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.860630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.861204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.864767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.880201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 419/839] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.883540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.894963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce03fb-d719-458f-89ae-350a70bd3adf admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.900148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.900891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.901175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.901458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.902402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:32.902714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.904621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010778aa-d4ab-400e-8599-817e63162e0c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:32.916190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 421/840] 10.222.0.79 () {56 vars in 1135 bytes} [Fri Jan 28 01:47:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:32.919024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:32.933194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605594-8870-424f-9e39-2fac52efe9c4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:32.938895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:32.943050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:32.943050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:32.943050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:32.943050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:32.947248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd577f-539c-4b7d-841e-4dede4e48909 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.042838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 420/841] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:33.061323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec9c2-547a-47fd-8cdc-950e5c13a6b3 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.061682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec9c2-547a-47fd-8cdc-950e5c13a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.062087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec9c2-547a-47fd-8cdc-950e5c13a6b3 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.064809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 422/842] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:33.074110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.074590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.075065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.100725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:33.101998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:33.130471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 421/843] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:33 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:33.165842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec9c2-547a-47fd-8cdc-950e5c13a6b3 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.181208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec9c2-547a-47fd-8cdc-950e5c13a6b3 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.187288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.188233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.188518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.188791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.203244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:33.212647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:33.214601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 423/844] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:33.223365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.237305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03affe6-1e28-40f2-aa5e-7bd457c940e0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.242597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.243259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.243591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.243869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.244700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.245009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.246608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.256002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 422/845] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:33.263918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.275487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ada7d0-8de9-46d5-b94c-6fff44a16947 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.284671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.288088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.288661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.289177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.306377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.309866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.334833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:33.336802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 424/846] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:33.343099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.355656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386c4d8-cf40-4229-8d33-c9cc100ce2ab admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.360968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.361988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.362468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.362997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.363909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.364560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.366408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.380820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 423/847] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:33.388039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.400436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e4135-dae0-491a-9d46-630c8b7714f7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.405146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.406033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.406319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.406601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.416813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.418859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.434538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:47:33.440083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 425/848] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:33.444103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.457300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5619419-2103-4a88-8be6-fc4cf675c953 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.462922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.464252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.464813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.465378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.467169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.468081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.470829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.497037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 424/849] 10.222.0.79 () {56 vars in 1170 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:33.504320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.514300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55362-9161-4420-b86b-82f1b3571c00 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.520600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.521598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.522104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.522574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.531760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.533863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.548101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 426/850] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/auth/tokens => generated 2291 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:33.551261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.561675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74649646-bb75-416f-bf24-9e75ba515422 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.568475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.569519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.569956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.570414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.582683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.584831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.603707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:33.610443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 425/851] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:33.612544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.622214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e27ee-d6ef-4b99-85a3-8e57bf34f161 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.628164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.629241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.629672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.630081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.631072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.631563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.633362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.656124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 427/852] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:33.658934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.669937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52236470-348c-4f14-8381-6e312372ece2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.675591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.676717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.677150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.677593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.687581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.689929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.703781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:33.711186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 426/853] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:33.712857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.724661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d3e4-3543-46b4-9554-9dd08318a0e3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.729756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.730668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.731092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.731534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.732524 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.732970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.735040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717eb276-016d-4d01-9b84-011654f76e2e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.755408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 428/854] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:33.756978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:33.769679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cf55e-5410-47a0-80bc-8281764dc181 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:33.774818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:33.775675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:33.776132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:33.776591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:33.777551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] RBAC: Adding query filter params (role.id=9573db05e12e4a6a81e19ca501fc627c, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=ab844b86bc184fa8b6da36559bea546e) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:33.778024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:33.780084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd2add-4fea-449d-a89e-ea58627fc57e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:33.792117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 427/855] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:33 2022] GET /identity/v3/role_assignments?user.id=ab844b86bc184fa8b6da36559bea546e&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=9573db05e12e4a6a81e19ca501fc627c => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:35.099934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dd4-4a3a-4f5f-815f-5c1502c23254 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.100462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dd4-4a3a-4f5f-815f-5c1502c23254 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.100567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273dd4-4a3a-4f5f-815f-5c1502c23254 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.102525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 429/856] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:35.110432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.110928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.111204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.133821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:35.135033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:35.148523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 428/857] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:35 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:35.172268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273dd4-4a3a-4f5f-815f-5c1502c23254 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.185425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273dd4-4a3a-4f5f-815f-5c1502c23254 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.190425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.191211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.191516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.191796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.192516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.194206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.205745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:47:35.207248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 430/858] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:35.214160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.224345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c5ce8-02e9-4e75-b54b-f08189e8ad31 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.229077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.229834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.230124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.230397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.231111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:35.231420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.233153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca3ddc-7e78-41cb-a89b-ba102df35d83 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.238993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 429/859] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:35.246647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.262733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bd730-8c54-41bc-abef-2cd1e0eebce9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.268359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.269388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.269928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.270410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.271344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:35.272000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.273917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8200fb-0957-4651-b6e3-3134485448f1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.280209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 431/860] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:35.468065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040ce4-b592-4840-963b-648bb0a05822 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.468782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040ce4-b592-4840-963b-648bb0a05822 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.469268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040ce4-b592-4840-963b-648bb0a05822 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.472716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 430/861] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:35.481182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.481774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.482267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.502545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:35.503788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:35.512731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 432/862] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:35 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:35.538998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040ce4-b592-4840-963b-648bb0a05822 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.555688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03040ce4-b592-4840-963b-648bb0a05822 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.562997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.564021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.564514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.564787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.565532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.567133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.578896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6a31b3f8-16c3-4aef-bfb4-02ea4d08acfa admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:47:35.581551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 431/863] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:35.588494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.598614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457f90a-67dc-4f4b-9c8f-da665ab8796b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.598969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457f90a-67dc-4f4b-9c8f-da665ab8796b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.599169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457f90a-67dc-4f4b-9c8f-da665ab8796b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.599270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d23f-b05b-46db-89f0-6a2a10a85bf0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.601235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 432/864] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:35.604160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.604824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.605103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.605376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.606084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:35.606379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.608114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.608831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.609363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.609363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.614611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 433/865] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:35.621791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.628181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:35.629428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:35.632226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5eefe-f2a7-49e7-9674-08d763b0ec9d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.637311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.638242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.638596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 433/866] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:35 2022] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:35.638931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.639414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.640364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:35.640883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.643298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.649752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 434/867] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:35.657712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.669609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3045324-8af7-495c-ada7-582c09159d40 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.674198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.675439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.676204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.676491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.676766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.677582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.679239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.687639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a668-1892-4957-a96e-d91da42c6b50 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.693063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.693730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.694010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.694362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.695244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.697233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.698659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.common [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:47:35.753226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.sql.core [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 28 01:47:35.753226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 28 01:47:35.753226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [parameters: {'id': '0a5d039e26184da9b4866025f74633f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 28 01:47:35.753226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79742) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:47:35.759725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a5d039e26184da9b4866025f74633f0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0a5d039e26184da9b4866025f74633f0. Jan 28 01:47:35.766760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 435/868] 10.222.0.79 () {60 vars in 1161 bytes} [Fri Jan 28 01:47:35 2022] POST /identity/v3/projects => generated 262 bytes in 88 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:35.768494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 434/869] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:35.769873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.782095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c04753-e2b9-4b30-853f-afaff6834548 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.804341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.805200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.805478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.805754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.813918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.816845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.831935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-1c565753-59a5-4590-9415-35478eacbd08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:35.833642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 436/870] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:35.840587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:35.852202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dd2ff-5d5a-4bcc-b56b-a7039d3ae71a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:35.857622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:35.858652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:35.859141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:35.859653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:35.861254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:35.862231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:35.865445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2f123-dd11-40aa-ba77-beb8f25d4ff6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:35.888247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 435/871] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:36.114859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772698-cb6a-4e2f-b32f-f338369dbc60 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:36.115334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772698-cb6a-4e2f-b32f-f338369dbc60 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:36.115334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f772698-cb6a-4e2f-b32f-f338369dbc60 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:36.117434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 437/872] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:36.125030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:36.125492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:36.125565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:36.146013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:36.147209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:36.160093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 436/873] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:36 2022] POST /identity/v3/auth/tokens => generated 2480 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:36.179424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772698-cb6a-4e2f-b32f-f338369dbc60 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:36.196908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f772698-cb6a-4e2f-b32f-f338369dbc60 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:36.202145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:36.203197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:36.203702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:36.204232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] PATH_INFO: `/v3/services/image` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:36.205679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:36.207717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:36.219698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:47:36.222365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 438/874] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Jan 28 01:47:36 2022] GET /identity/v3/services/image => generated 86 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:36.232013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:36.238340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41d8b-78a7-4aa8-9471-16a46d827dfe None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:36.242913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:36.243570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:36.243851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:36.244226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:36.244941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:36.245247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:36.246839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308121c-db8b-43ba-a184-bf9bba322055 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:36.252397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 437/875] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:36.258963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:36.270156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8049f-9e14-4690-9eca-8e334a7d791d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:36.274974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:36.275639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:36.275926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:36.276230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:36.276940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:36.277249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:36.278932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4acb4-8210-4ce3-b60f-e5c63ed3972b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:36.285419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 439/876] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:37.667256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda050-6986-4622-85db-949a9569108d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:37.667805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda050-6986-4622-85db-949a9569108d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:37.667805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cda050-6986-4622-85db-949a9569108d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:37.669870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 438/877] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:37.677445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c56f-ab85-45e1-a4be-7bb6d9066401 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:37.677904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c56f-ab85-45e1-a4be-7bb6d9066401 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:37.677975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867c56f-ab85-45e1-a4be-7bb6d9066401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:37.698771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4867c56f-ab85-45e1-a4be-7bb6d9066401 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:37.700329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4867c56f-ab85-45e1-a4be-7bb6d9066401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:37.709222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 440/878] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:37 2022] POST /identity/v3/auth/tokens => generated 2480 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:37.738977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda050-6986-4622-85db-949a9569108d None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:37.751743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cda050-6986-4622-85db-949a9569108d None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:37.756552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:37.757204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:37.757674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:37.757957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:37.758703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:37.760316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42cbf9-daac-40ba-88a4-dd748ba2ab08 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:37.837710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 439/879] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:37 2022] POST /identity/v3/services => generated 242 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:38.129151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6d51-70b9-4809-b834-60fced475e3f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.129603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6d51-70b9-4809-b834-60fced475e3f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.129603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6d51-70b9-4809-b834-60fced475e3f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.131747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 441/880] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:38.140287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.140782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.141242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.161841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:38.163689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:38.185285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 440/881] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:38 2022] POST /identity/v3/auth/tokens => generated 2576 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:38.210189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6d51-70b9-4809-b834-60fced475e3f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.225156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6d51-70b9-4809-b834-60fced475e3f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.229758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.230553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.230844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.231179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.231841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.233483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.246650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b536557d-f091-4cb1-83ee-08fef48a4511 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:47:38.252268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 442/882] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:38.255276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.264669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bf72a-8eb0-45a2-b88e-300a69263d1e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.270053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.270784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.271073 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.271352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.272097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:38.272413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.274078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.275266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef2c0-9aa5-454b-a262-6831cbfa7ffa None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.275627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef2c0-9aa5-454b-a262-6831cbfa7ffa None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.275905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef2c0-9aa5-454b-a262-6831cbfa7ffa None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.277968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 443/883] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:38.280561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 441/884] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:38.286070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.286352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.286626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.289139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.300183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c174901-5dbd-40a7-903c-15ef9e7caddc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.306365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.307385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.307705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:38.308110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.308555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.309194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:38.309629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:38.310109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.312317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.318225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 444/885] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:38 2022] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:38.319005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 442/886] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:38.325672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.335920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f46c2-d676-4629-806e-9774f42ab13e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.340897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.341541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.341820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.342093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.342871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] RBAC: Adding query filter params (interface=admin, service_id=efab79b09e1846008275252a4b819556, region_id=RegionOne) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:38.343179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.344805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.351537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 445/887] 10.222.0.79 () {56 vars in 1270 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/endpoints?service_id=efab79b09e1846008275252a4b819556&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:38.353543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.357817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.368376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062594d-ef17-4dbf-85da-93981b7cddea admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.370789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449746c-a814-43bf-abc5-f0e54901d5f9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.373191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.373962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.374348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.374624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.375309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.377073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.377651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.378565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.379047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.379576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.380554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.382590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.384142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.common [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:47:38.384539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 446/888] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:47:38.435800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.sql.core [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 28 01:47:38.435800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 28 01:47:38.435800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [parameters: {'user_id': '7e1e30c188de4284abb1ddaba3094d64', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 28 01:47:38.435800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79743) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:47:38.452029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 28 01:47:38.453901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 443/889] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 01:47:38 2022] POST /identity/v3/users => generated 160 bytes in 101 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:38.463136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.477767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8ca6d-3e65-4e49-9de8-4c49bec945f0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.485460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.487079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.487580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.488157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.498311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.500661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.516944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9408c7e7-ba44-469b-9359-9090979d8121 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:47:38.519322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 447/890] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:38.526493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.540749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8a1ff-eb32-4fe4-8dee-bde2ffdd7747 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.546046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.546999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.547290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.547567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.548540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:38.548852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.551262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.555238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0bb3-bceb-447d-a769-f03d2e67bfc0 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.555529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0bb3-bceb-447d-a769-f03d2e67bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.555791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0bb3-bceb-447d-a769-f03d2e67bfc0 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.558079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 448/891] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:38.568980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f08e-00af-4ac6-88c4-fa5e1f92b95a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.569413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f08e-00af-4ac6-88c4-fa5e1f92b95a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.569815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f08e-00af-4ac6-88c4-fa5e1f92b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.590266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-16b7f08e-00af-4ac6-88c4-fa5e1f92b95a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:38.591667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-16b7f08e-00af-4ac6-88c4-fa5e1f92b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:38.600641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 444/892] 10.222.0.79 () {56 vars in 1122 bytes} [Fri Jan 28 01:47:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:38.602202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 449/893] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:38 2022] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:38.629519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:38.642756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1c2bf-165a-4820-a573-a926849feb95 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:38.648301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:38.649495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:38.649946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:38.650409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:38.651349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:38.653172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda5daa-91cc-46e6-bb7e-d5dc94079eed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:38.735058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 445/894] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:38 2022] POST /identity/v3/services => generated 242 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:40.378708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd81f5b-3c94-42fa-bf2f-a83ffed00190 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.379222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd81f5b-3c94-42fa-bf2f-a83ffed00190 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.379293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd81f5b-3c94-42fa-bf2f-a83ffed00190 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.383996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 450/895] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:40.392877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.393925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.394400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.415463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:40.417114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:40.442137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 446/896] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:40 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:40.465914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd81f5b-3c94-42fa-bf2f-a83ffed00190 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.479521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd81f5b-3c94-42fa-bf2f-a83ffed00190 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.483935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.484795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.485072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.485342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.486748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.488700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.505854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:47:40.507712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 451/897] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:40.515223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.525934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23923-cda4-4a4e-bd4a-8bb3a64c087f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.532007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.532007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.532244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.533142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.535203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:40.535203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.535901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.543997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 447/898] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:40.548012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.558717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581caa-1013-4b1e-8650-3e79191a252b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.563991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.564498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.564781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.565289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.565955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:40.566266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.568490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.574556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 452/899] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:40.582977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.593888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a3254-bf3c-4583-ba84-369045efac72 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.600190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.600992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.601349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.601702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.602636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] RBAC: Adding query filter params (interface=public, service_id=1210ef66f30e4f9899d39a54fc738b9d, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:40.602960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.604728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1786-93c5-4f8c-ba00-8a64f0ea3195 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.611201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 448/900] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/endpoints?service_id=1210ef66f30e4f9899d39a54fc738b9d&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:40.617901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.628820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50372-3c57-4895-a74b-d2475a5c9273 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.633923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.634716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.635072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.635415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.636229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.637894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206d43e-b383-4461-b9f7-04f314037076 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.646537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 453/901] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:47:40.824926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3fe-b883-4e0f-a0cf-03ad2c3f5c3b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.825211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3fe-b883-4e0f-a0cf-03ad2c3f5c3b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.825487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0f3fe-b883-4e0f-a0cf-03ad2c3f5c3b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.827561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 449/902] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:40.837385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.837886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.838367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.865324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:40.866759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:40.878210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 454/903] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:40 2022] POST /identity/v3/auth/tokens => generated 2672 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:40.911190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f3fe-b883-4e0f-a0cf-03ad2c3f5c3b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.926887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0f3fe-b883-4e0f-a0cf-03ad2c3f5c3b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.932021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.932960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.933399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.933803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.934632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.936408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.949122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:47:40.950515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 450/904] 10.222.0.79 () {56 vars in 1147 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:40.959227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:40.973876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f342df4-a216-49e0-82dd-93befacc4d59 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:40.982290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:40.983198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:40.983550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:40.983923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:40.984843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:40.985468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:40.988804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:40.996076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 455/905] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:41.011530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.026315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33294a6c-cce9-43fe-b0c6-a951816a529d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.031289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.032183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.032475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.033395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.034107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:41.034479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.036094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66950fa9-dcf5-482f-a51f-679190585610 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.041723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 451/906] 10.222.0.79 () {56 vars in 1143 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:41.048248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.059265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86c31-b17d-45bd-996a-643cd69fd242 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.063988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.065037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.065412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.065922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.067241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.068384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:41.068384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:41.068384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:41.070017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc6bfb-d42b-4479-893f-761432eaceda admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.163797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 456/907] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:41.204524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3335-115d-4878-bf10-4a4891cc2da6 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.204906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3335-115d-4878-bf10-4a4891cc2da6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.205113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3335-115d-4878-bf10-4a4891cc2da6 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.207110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 452/908] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:41.215384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.215826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.216278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.241076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:41.242292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:41.261646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 457/909] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:41 2022] POST /identity/v3/auth/tokens => generated 2821 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:41.286654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b3335-115d-4878-bf10-4a4891cc2da6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.300412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b3335-115d-4878-bf10-4a4891cc2da6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.305286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.306269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.306695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.306986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.307749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.309500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.326048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:47:41.332014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 453/910] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/services/image => generated 86 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:41.336620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.347735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa673178-7ad3-4f11-b34a-a68296042e56 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.352586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.353255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.353538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.353816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.354538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:41.354875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.356493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.383593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 458/911] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:41.390870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.402769 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca367d4-f2e9-4cbe-97bc-4ceb52aa9471 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.408461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.409908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.410326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.410693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.411427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:41.411744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.413524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.425529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 454/912] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:41.432252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.444013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b00fe-462e-46ba-a15f-fc2e02c64604 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.449113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.449931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.450451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.450846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.451917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] RBAC: Adding query filter params (interface=public, service_id=c0c567ff0fa34f128ea94f171b6baa2e, region_id=RegionOne) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:41.452352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.454316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20920d-20ba-4fae-abc6-dcb450103389 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.468012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 459/913] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/endpoints?service_id=c0c567ff0fa34f128ea94f171b6baa2e&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:41.472383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:41.485536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802013-9c1d-468b-9006-69864f8d431c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:41.490748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:41.491404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:41.493990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:41.493990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:41.493990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:41.494448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba64a08-b7fe-4e72-961b-16da7a3d89cb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:41.502649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 455/914] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:47:41 2022] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:47:43.038110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1c19-be8a-4fee-988d-38a71b098535 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.038946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1c19-be8a-4fee-988d-38a71b098535 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.038946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1c19-be8a-4fee-988d-38a71b098535 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.040499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 460/915] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:43.049166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.049782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.049782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.069039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:43.070380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:43.079172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 456/916] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:43 2022] POST /identity/v3/auth/tokens => generated 2821 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:43.106835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de1c19-be8a-4fee-988d-38a71b098535 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.119695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de1c19-be8a-4fee-988d-38a71b098535 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.125150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.125938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.126315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.126586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.127282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.129078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.149366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:47:43.150843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 461/917] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:43.157328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.167176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108158fb-bdcd-48b3-97d4-3578e501ba3e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.172105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.172761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.173066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.173491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.174295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:43.174609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.176241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.182494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 457/918] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:43.189219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.202775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135bf5-06aa-4dd0-9688-1c1de350f3a8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.207922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.208604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.209779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.209779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.209779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:43.212615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.212615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ff375-e0d6-424b-ba0d-0fb60a3c3758 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.217693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 462/919] 10.222.0.79 () {56 vars in 1133 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:43.224523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.236864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194dcc-9e02-4787-98a3-4e7009b41aa1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.244163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.245375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.245916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.246468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.247843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.250760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51fe74-f7a1-49a8-ab25-48ba3c4a96b1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.374706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 458/920] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:43.520037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe84c5-0ffd-4a6f-9354-99749f6fdda6 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.520679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe84c5-0ffd-4a6f-9354-99749f6fdda6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.520892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe84c5-0ffd-4a6f-9354-99749f6fdda6 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.523791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 463/921] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:43.531930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.532269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.533153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.553374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:43.553889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:43.572535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 459/922] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:43 2022] POST /identity/v3/auth/tokens => generated 2977 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:43.600710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe84c5-0ffd-4a6f-9354-99749f6fdda6 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.614112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe84c5-0ffd-4a6f-9354-99749f6fdda6 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.618728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.619782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.621300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.621300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.622481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.624191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8c762-d449-45d1-994e-cc111713c5f5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.626164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 464/923] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:43.632383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.645931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f454dd-beac-48ec-a24a-47adbcdee273 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.650756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.651474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.651760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.652082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.652836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.654741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.770418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6db93-ba44-4ca7-978b-b0b950abc822 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.771272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6db93-ba44-4ca7-978b-b0b950abc822 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.771272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6db93-ba44-4ca7-978b-b0b950abc822 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.772857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 465/924] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:43.780027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.780401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.780569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.788006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 460/925] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:47:43 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:47:43.801900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:43.803157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:43.878200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 466/926] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:43 2022] POST /identity/v3/auth/tokens => generated 2977 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:43.902689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.914392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26550df0-52b9-4efb-af0c-c9e3590b7e07 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.919279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.920121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.920450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.920720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] PATH_INFO: `/v3/services/image` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.921317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.923000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.934867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:47:43.936368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 461/927] 10.222.0.79 () {56 vars in 1126 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:43.944612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.959685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352758a-a653-4645-b08e-51f154ab2289 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.964973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.965639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:43.965915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:43.966186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:43.966903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:43.967208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:43.968869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:43.974704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 467/928] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:43.981548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:43.994098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629d1c1-a0b3-433c-8c34-a3e0a2e217fb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:43.999109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:43.999919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:44.000229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:44.000492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:44.001963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:44.002271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:44.003894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2de2d-c822-47dd-9a73-61eca2f01153 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:44.009468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 462/929] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:44.015897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:44.027439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff255ad-6a75-494c-acc7-e2c2afb1c9e7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:44.033710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:44.034352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:44.034630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:44.034900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:44.035637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:44.037476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ac7d-1275-45ef-84d6-8f4fa345eda6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:44.114122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 468/930] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:47:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:45.914318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172b0b-a0f2-45e9-8780-89f0a3b90ee4 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:45.914927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172b0b-a0f2-45e9-8780-89f0a3b90ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:45.914927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2172b0b-a0f2-45e9-8780-89f0a3b90ee4 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:45.916904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 463/931] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:45.925087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b56e0-8514-456e-967d-74e47017598d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:45.925837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b56e0-8514-456e-967d-74e47017598d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:45.925837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b56e0-8514-456e-967d-74e47017598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:45.945196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-104b56e0-8514-456e-967d-74e47017598d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:45.946510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-104b56e0-8514-456e-967d-74e47017598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:45.965201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 469/932] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:45.991727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172b0b-a0f2-45e9-8780-89f0a3b90ee4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.014075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2172b0b-a0f2-45e9-8780-89f0a3b90ee4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.019398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.020248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.020524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.020801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.032161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:46.039684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:46.041126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 464/933] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:46.049108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b56e0-8514-456e-967d-74e47017598d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.059029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b56e0-8514-456e-967d-74e47017598d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.067833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.069032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.069489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.069842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.070712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.073077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.073077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e2ff-48c0-4fa6-a556-e56cdf7afb28 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.088007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 470/934] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:46.090474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.104114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3b455-3490-4ff8-bed3-27f975879c58 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.111734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.112989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.113465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.113926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.136121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.141714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.167721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e71d-cd42-4dd9-82a1-c760c8f046ff None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.168057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e71d-cd42-4dd9-82a1-c760c8f046ff None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.168275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e71d-cd42-4dd9-82a1-c760c8f046ff None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.170080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 471/935] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:46.173741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:46.175936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 465/936] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:46.181451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.181755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.182018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.186340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.199869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779aff-ec85-41e1-b61b-ee1f8ec92a33 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.204855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.205519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.205797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.206083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.206816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.207125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.208065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:46.208781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.209922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:46.224052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 466/937] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:46.228187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 472/938] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:46.230619 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.245590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17979-e539-4ce3-9a8f-fc48b2a9c58c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.250011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.250908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.251414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.252326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.254081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.260283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.262559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.269811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81bc73-0111-45db-8f7a-f3fb4f567c1b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.277366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.277705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:46.278679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.279106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.279520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.281684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.285625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 467/939] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:46.286420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.288918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.290543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 473/940] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:46.296674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.302949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ddd8f-691d-41c7-8887-eb031344842b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.307652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b986ea-d53f-40f6-8511-eb985cb7cc18 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.309885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.309885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.309885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.309885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.310481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.310613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.312532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.313476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.314174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.314481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.314929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.315456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.317512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.335548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 468/941] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:46.342358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.356631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49220ecb-a799-47f6-a76f-567581acfa36 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.366464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.367886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.368069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.368567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.383784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.386575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.400695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 469/942] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:47:46.408666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.412763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 474/943] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:47:46 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:46.421584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df3bd4-15ef-4aa8-83fc-ee73be591e89 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.429148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.430165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.430574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.431102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.444673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.447126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.467564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-143c5927-ffa6-461c-b473-cf3510740862 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:46.469265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 470/944] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:46.479074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.487913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66dd7b-7832-452a-b34b-f997f2ee5661 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.488810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66dd7b-7832-452a-b34b-f997f2ee5661 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.489197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66dd7b-7832-452a-b34b-f997f2ee5661 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.492398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 471/945] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:47:46.495073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df901-693f-4f67-b8a7-7d889cceeef0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.503393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.503863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.504419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.505375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.506354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.506652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.506999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.507786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.508132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.510124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.526367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 475/946] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:46.533922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.534398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:46.535856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:46.549545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 472/947] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:46.550174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bd996-1d8a-4d8d-81e0-a72636ca6e7c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.560272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.561218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.561616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.561890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.572138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.575873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.582259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.597339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1022a7e-6de6-4fed-9090-dd6125092901 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.598389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:46.605581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 476/948] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:46.607702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.608523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.609432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.609870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.610290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.620259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.622035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.628098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627802a-e5c3-4d11-ba15-93182dd052f1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.635114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.635840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.636157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.636437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.637330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.639741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.641241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.643833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 473/949] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:46.652353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.668689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c9c75-9bc3-4728-ac1e-b05375dbd8f2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.669476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 477/950] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:46.677503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:46.681381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.682233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.682513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.682912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.684562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.686685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02179d-db90-4b99-9dc7-fa0ac09f69d3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.689616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 474/951] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:46.690323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f442f07-e035-497a-beb6-c1991b94b20c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:46.696752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:46.696752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:46.698449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:46.698449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:46.698449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] RBAC: Adding query filter params (role.id=9573db05e12e4a6a81e19ca501fc627c, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:46.700552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:46.702168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30061aa-9453-48ef-a0df-11140316d230 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:46.710433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 478/952] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:46 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=9573db05e12e4a6a81e19ca501fc627c => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:48.893578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e630-8485-4f32-85bd-4dfd225accb5 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:48.894125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e630-8485-4f32-85bd-4dfd225accb5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:48.894125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e630-8485-4f32-85bd-4dfd225accb5 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:48.895939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 475/953] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:48.904699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb636a-ba00-41e6-963c-cb02f4bb457e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:48.906816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb636a-ba00-41e6-963c-cb02f4bb457e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:48.906816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb636a-ba00-41e6-963c-cb02f4bb457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:48.935599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-11eb636a-ba00-41e6-963c-cb02f4bb457e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:48.936855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-11eb636a-ba00-41e6-963c-cb02f4bb457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:48.945398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 479/954] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:48.971538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e630-8485-4f32-85bd-4dfd225accb5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:48.983741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e630-8485-4f32-85bd-4dfd225accb5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:48.988277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:48.989066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:48.989343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:48.989750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.000866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:49.002690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a559-2f6d-49c2-bba7-1133e0b4a44c None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.002988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a559-2f6d-49c2-bba7-1133e0b4a44c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.003433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63a559-2f6d-49c2-bba7-1133e0b4a44c None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.005278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 480/955] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:49.008162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:49.014854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 476/956] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:49.014990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.014990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.015470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.015984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.027713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d69b9-4929-4117-9161-ecf1e83dd9ac admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.034763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.035708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.036213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.036669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.037326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:49.037906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.038406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.039184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:49.041477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.049326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 481/957] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:49.052191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 477/958] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.058471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.069173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969aa460-7d63-4caf-94cb-bb2c8c8da6d7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.073260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.073912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.074769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.075046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.075315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] PATH_INFO: `/v3/users/7dc75a2f9d104bc093266b790a6839a5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.083906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fc12c-9bfe-4066-998e-f94500dfc3c9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.089403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.090216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.090498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.090772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.092770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] RBAC: Authorizing `identity:get_user(user_id=7dc75a2f9d104bc093266b790a6839a5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.097146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.098889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 482/959] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/users/7dc75a2f9d104bc093266b790a6839a5 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:49.102176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:49.105703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.109311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:49.111147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 478/960] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:49.116978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51445ef1-756d-48a0-8209-2d2f594d65ab admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.117866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.122391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.123037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.123320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.123599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.128690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11108a08-e763-466a-be64-f119fd15b806 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.134393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.136394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.137044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.137143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.137326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.137609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.140622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.140622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.140622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.148230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 483/961] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:47:49.152020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 479/962] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.154902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.155591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.164613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ed431-1c8f-46e2-ac9d-67738bc370b0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.165785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bdc2e-453b-4065-a3f8-1ce168ee61b1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.170038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.170767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.170895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.171152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.171427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.171575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.171804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.172186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.172716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.175105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.177062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 484/963] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.183688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.183861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.186375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.197538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b7a8-e042-42d8-8948-44cbc286d2aa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.203193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.203836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.204862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.205133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.205944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:49.206071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=81bf56c01e914cdfa1a63a03503dde77, user.id=7dc75a2f9d104bc093266b790a6839a5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.206254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.207289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 480/964] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:49.208284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.214071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.222381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 485/965] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/role_assignments?user.id=7dc75a2f9d104bc093266b790a6839a5&scope.project.id=81bf56c01e914cdfa1a63a03503dde77&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.224866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75cd57-8dee-4c59-8056-e36dbddc34be admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.229912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.230597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.230880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.231156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.231912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.232258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.233913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.256262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 481/966] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.268198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.275118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93966c3-8d3b-4d1b-bfcf-f60a49165fd2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.280601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.281498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.281841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.282211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.291278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.293448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.309999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:49.311511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 486/967] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:49.318992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.330266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caecaa1-f9f3-4ab3-b7e7-9125173a61c4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.335285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.335965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.336279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.336606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.337506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.337887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.340137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.382372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 482/968] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:49.387134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.398497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07857-f690-4832-864d-50307ad26043 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.403268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.404088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.404371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.404643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.415720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.417623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.434577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:49.435777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 487/969] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:49.442864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.452521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0baa-75f4-4529-9457-8e8b27992db4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.458258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.458917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.459199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.459477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.460227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.460535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.462117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.484729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 483/970] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:49.491394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.503794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bba2b4-edff-4c9e-bd75-b32d003b44d0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.510000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.510932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.511144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.511327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.519394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.521379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.534225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:49.535397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 488/971] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:49.541900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.552182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758ce5f-96a2-4605-8848-db1ec751af6e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.556781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.557432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.557825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.558101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.558912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:49.559204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.561099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb57b-1738-42c1-9e2e-d7bf90e18f38 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.574204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 484/972] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:49.581857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:49.592810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145148d-5e71-4ae8-8bef-d10e66e1032d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:49.604537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:49.605407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:49.605684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:49.605962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/9573db05e12e4a6a81e19ca501fc627c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:49.608172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=77dde5aa087649f5873dc17c6fc175c5, role_id=9573db05e12e4a6a81e19ca501fc627c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:49.611309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78ac64-b0ec-4f0a-9d5f-efd9e6b17b09 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:49.684451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 489/973] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:49 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/77dde5aa087649f5873dc17c6fc175c5/roles/9573db05e12e4a6a81e19ca501fc627c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:51.436881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744755-9b7d-408a-9cbb-8a7e4be46d8c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.437445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744755-9b7d-408a-9cbb-8a7e4be46d8c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.437445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744755-9b7d-408a-9cbb-8a7e4be46d8c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.439477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 485/974] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:51.450427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be602da-240d-4e42-a275-13854a14f052 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.450427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be602da-240d-4e42-a275-13854a14f052 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.450427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be602da-240d-4e42-a275-13854a14f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.474331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0be602da-240d-4e42-a275-13854a14f052 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:51.475528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0be602da-240d-4e42-a275-13854a14f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:51.541233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 490/975] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:51.566467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1744755-9b7d-408a-9cbb-8a7e4be46d8c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:51.580456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1744755-9b7d-408a-9cbb-8a7e4be46d8c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:51.586966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:51.587840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.588171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.588705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.600910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:51.607757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:51.609288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 486/976] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:51.616843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be602da-240d-4e42-a275-13854a14f052 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:51.626597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be602da-240d-4e42-a275-13854a14f052 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:51.633530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:51.634557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.635005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.635441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.636774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:51.637248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:51.640315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:51.652730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 491/977] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:51.661474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:51.676284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7f8-8421-4734-b00c-1e20324892f1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:51.681529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:51.682429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.682710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.682982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] PATH_INFO: `/v3/users/7dc75a2f9d104bc093266b790a6839a5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.684349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] RBAC: Authorizing `identity:get_user(user_id=7dc75a2f9d104bc093266b790a6839a5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:51.686511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:51.688358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 487/978] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:47:51 2022] GET /identity/v3/users/7dc75a2f9d104bc093266b790a6839a5 => generated 285 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:51.696436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:51.707858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcff9-ad32-4cb2-badd-281e0bc7dff0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:51.712737 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:51.713991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.714362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.714724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.716036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:51.718104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915f908-3296-4a08-b259-c844bcac99cb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:51.720616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 492/979] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:47:51 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:51.731334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:51.748945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3de49e-d2f3-47e9-bdc1-2223cd3b31fe admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:51.754702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:51.755654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:51.756022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:51.756373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77/users/7dc75a2f9d104bc093266b790a6839a5/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:51.759304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf56c01e914cdfa1a63a03503dde77, user_id=7dc75a2f9d104bc093266b790a6839a5, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:51.762495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085388a-a82e-499e-9b04-80e816d5ed81 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:51.853139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 488/980] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:47:51 2022] PUT /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77/users/7dc75a2f9d104bc093266b790a6839a5/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:47:52.036305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509244c9-e859-489e-a987-887bb9067503 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.036619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509244c9-e859-489e-a987-887bb9067503 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.037013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509244c9-e859-489e-a987-887bb9067503 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.039624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 493/981] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:52.052337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.052797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.053168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.077906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:52.081379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:52.182476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 489/982] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:52.207823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509244c9-e859-489e-a987-887bb9067503 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.221128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509244c9-e859-489e-a987-887bb9067503 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.225988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.226848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.227253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.227412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.238601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:52.245886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:47:52.247106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 494/983] 10.222.0.79 () {56 vars in 1141 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:52.255049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.271562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f5d4-c7c2-4f2a-85bb-2f278b0690e7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.279364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.280703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.281252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.281727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.283147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.283682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.287027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.302198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 490/984] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:52.308888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.320835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883a046-42b6-42f0-a13e-99beacce0c5b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.325573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.326349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.326630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.326909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.340882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.343684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.370336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:52.372196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 495/985] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:52.380316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.395467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615768d2-770d-4f27-bbfe-bca61897a2c8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.401737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.402423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.402774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.403050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.403804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.404148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.406009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.419140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 491/986] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:52.426069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.441821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c359b1-100b-46c2-a4b4-4ae85028c822 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.446863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.447664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.447946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.448292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.459602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.463042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.478575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:47:52.479831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 496/987] 10.222.0.79 () {56 vars in 1114 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:52.487642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.505899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74c5fb-35ba-4814-af7f-777750cd447f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.513705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.514802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.515362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.515824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.518050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.518606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.522208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.555624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 492/988] 10.222.0.79 () {56 vars in 1154 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:52.566049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.576400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3cbc-b569-4685-879e-0c90c2787e6e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.582132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.582779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.583061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.583498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.591963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.593750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.603030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 497/989] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:52.609538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.620864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bae32-eafe-4d32-acd0-b919404fa510 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.626670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.627525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.627814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.628193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.639577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.642115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.660281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:47:52.661537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 493/990] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:52.669529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.681881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746cf88-ac0d-4036-8b22-4c74e34b94ab admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.687600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.689218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.689503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.689841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.690619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.690942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.693220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.710805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 498/991] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:52.719257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.729845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0584-921f-4cb7-a7df-6c6ef4d1cadf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.734876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.736281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.736606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.736933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.744892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.746932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.762141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:47:52.763444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 494/992] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:47:52.770552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.785610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef58d60-dfce-435c-8367-7fd5ac32aa47 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.791779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.792800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.793227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.793548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.794779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.795173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.798672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f189a69-58e4-4b28-a8c2-f40052be5b1a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.814915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 499/993] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:52.822317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:52.837185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94023bb-db1e-4ea9-9c9f-cbb088abe200 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:52.845281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:52.846156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:52.846492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:52.846817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:52.847907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] RBAC: Adding query filter params (role.id=9573db05e12e4a6a81e19ca501fc627c, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=77dde5aa087649f5873dc17c6fc175c5) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:52.848314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:52.850841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ecfe2-ea27-46b1-a966-8c6931bd1e07 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:52.857431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 495/994] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:52 2022] GET /identity/v3/role_assignments?user.id=77dde5aa087649f5873dc17c6fc175c5&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=9573db05e12e4a6a81e19ca501fc627c => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:54.241163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36487-c4a3-4bc0-9739-03df67856810 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.241691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36487-c4a3-4bc0-9739-03df67856810 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.241691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36487-c4a3-4bc0-9739-03df67856810 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.243503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 500/995] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:54.250949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.251918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.252167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.269403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:54.270586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:54.278632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 496/996] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:47:54.303885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36487-c4a3-4bc0-9739-03df67856810 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.316958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36487-c4a3-4bc0-9739-03df67856810 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.321908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.322780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.323147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.323529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.334562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:47:54.341501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:47:54.342650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 501/997] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:47:54.349801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.359053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29c036-31b4-4706-ba53-32e0f57d9a29 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.364514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.365159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.365441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.365715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.366457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:54.366763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:54.368391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:54.377336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 497/998] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:54.383745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.394203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0f142-3226-4567-a0c3-37f9d7afd7e4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.399383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.400186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.400487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.400765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] PATH_INFO: `/v3/users/7dc75a2f9d104bc093266b790a6839a5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.401951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] RBAC: Authorizing `identity:get_user(user_id=7dc75a2f9d104bc093266b790a6839a5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:54.404105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:54.405685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 502/999] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/users/7dc75a2f9d104bc093266b790a6839a5 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:54.413952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.424469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddc6a1-9c67-4b81-b233-31c27bd32bc8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.429208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.429874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.430207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.430425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.439062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:54.440838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:54.450174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 498/1000] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:54.461373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.473537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c63b-a797-425f-9d0f-2281d1e8f908 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.478135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.478970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.479255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.479532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.480742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:54.482823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cbfbf-f450-49fc-a978-614f9291755b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:54.484517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 503/1001] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:54.492646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:54.502097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354151-7bc6-4cf1-81b4-a23078f135b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:54.506917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:54.507566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:54.507845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:54.508154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:54.508978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=81bf56c01e914cdfa1a63a03503dde77, user.id=7dc75a2f9d104bc093266b790a6839a5) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:54.509291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:54.511119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6af42-afb1-4193-8671-219357e424aa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:54.517671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 499/1002] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:54 2022] GET /identity/v3/role_assignments?user.id=7dc75a2f9d104bc093266b790a6839a5&scope.project.id=81bf56c01e914cdfa1a63a03503dde77&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:56.764363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83852-9b06-494b-9866-cc35f20daf11 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:56.764929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83852-9b06-494b-9866-cc35f20daf11 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:56.765137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83852-9b06-494b-9866-cc35f20daf11 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:56.768272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 504/1003] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:56.775801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:56.776283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:56.776374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:56.794355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:56.795535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:56.803494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 500/1004] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:56.830435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d83852-9b06-494b-9866-cc35f20daf11 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:56.843511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d83852-9b06-494b-9866-cc35f20daf11 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:56.848172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:56.848937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:56.849213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:56.849480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:56.850645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:56.852349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad36ad-11e6-4c4b-b3ad-3f8259398ae1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:56.853922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 505/1005] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:47:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:56.863951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:56.872838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e8c6-d784-4d03-a95e-d2e371fd7e4f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:56.878528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:56.879188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:56.879469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:56.879744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:56.880487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:56.882394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62558d5a-74cd-4631-8e67-af851ffc6fae admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:57.004593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 501/1006] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:47:56 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:47:59.267222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c1ba0-99cb-4786-95c5-6b890745b6a7 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.267756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c1ba0-99cb-4786-95c5-6b890745b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.267756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c1ba0-99cb-4786-95c5-6b890745b6a7 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.270360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 506/1007] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:47:59.277162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.277825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.277825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.295991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:47:59.297797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:47:59.305662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 502/1008] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:47:59 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:47:59.331542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c1ba0-99cb-4786-95c5-6b890745b6a7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:59.344593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c1ba0-99cb-4786-95c5-6b890745b6a7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:59.350038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:59.350869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.351152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.351422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] PATH_INFO: `/v3/roles/f64957bf427046ef80071913d3681efc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.352932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] RBAC: Authorizing `identity:get_role(role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:59.353944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:47:59.353944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:47:59.353944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:47:59.354809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:59.356189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 507/1009] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:47:59 2022] GET /identity/v3/roles/f64957bf427046ef80071913d3681efc => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:59.363203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:59.372729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad888c-58b5-4eff-9c9e-d8f7516fd625 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:59.378653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:59.379557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.379842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.380167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] PATH_INFO: `/v3/users/5727cf446229439c95f2c9b33a2f030c` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.395149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5727cf446229439c95f2c9b33a2f030c)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:59.397465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:59.399124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 503/1010] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:47:59 2022] GET /identity/v3/users/5727cf446229439c95f2c9b33a2f030c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:47:59.405905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:59.416552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e8da-af62-401d-ab6d-8bd2881bc726 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:59.421374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:59.422027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.422369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.422649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.430768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:59.432576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:59.442283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 508/1011] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:47:59 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:47:59.449080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:59.459543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6615-e914-4934-ae57-84b843d390a1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:59.464400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:59.465254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.465529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.465797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.466943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:59.469608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf284-7f37-4947-b871-b66c7e6ac113 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:59.471325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 504/1012] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:47:59 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:47:59.478466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:47:59.487644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5120c28-c10c-43f5-94fb-9376b10c38fe admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:47:59.492389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:47:59.493023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:47:59.493307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:47:59.493584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:47:59.494411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=81bf56c01e914cdfa1a63a03503dde77, user.id=5727cf446229439c95f2c9b33a2f030c) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:47:59.494727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:47:59.496586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcadc9-b57c-4d9b-b17a-fc1a04e2af7f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:47:59.502458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 509/1013] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:47:59 2022] GET /identity/v3/role_assignments?user.id=5727cf446229439c95f2c9b33a2f030c&scope.project.id=81bf56c01e914cdfa1a63a03503dde77&role.id=f64957bf427046ef80071913d3681efc => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:01.710837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d4c52-2482-4780-87e7-c738e1593923 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.711381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d4c52-2482-4780-87e7-c738e1593923 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.711381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d4c52-2482-4780-87e7-c738e1593923 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.713422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 505/1014] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:01.721371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.721855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.721946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.740754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:01.741958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:01.749891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 510/1015] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:01.774926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d4c52-2482-4780-87e7-c738e1593923 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:01.787545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d4c52-2482-4780-87e7-c738e1593923 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:01.792622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:01.793454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.793737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.794013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] PATH_INFO: `/v3/roles/f64957bf427046ef80071913d3681efc` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.795482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] RBAC: Authorizing `identity:get_role(role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:01.796530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:01.796530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 01:48:01.796530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 01:48:01.798073 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:01.799422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 506/1016] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:01 2022] GET /identity/v3/roles/f64957bf427046ef80071913d3681efc => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:01.806288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:01.816362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0553bd-a250-4837-8444-d6884956d1a1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:01.820952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:01.821794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.822321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.822321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] PATH_INFO: `/v3/users/5727cf446229439c95f2c9b33a2f030c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.823678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] RBAC: Authorizing `identity:get_user(user_id=5727cf446229439c95f2c9b33a2f030c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:01.825821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:01.827394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 511/1017] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:01 2022] GET /identity/v3/users/5727cf446229439c95f2c9b33a2f030c => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:01.834430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:01.844733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f95e8a-c2b1-481a-967d-ed734563b5b2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:01.849686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:01.850521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.850801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.851074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.852287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:01.854333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629603-8988-484a-8a40-0bb25f84e05e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:01.856026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 507/1018] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:01 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:01.863898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:01.873894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4e3a-1b1c-4cf4-a3bc-9cb44772b925 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:01.879355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:01.880279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:01.880565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:01.880844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77/users/5727cf446229439c95f2c9b33a2f030c/roles/f64957bf427046ef80071913d3681efc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:01.883198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf56c01e914cdfa1a63a03503dde77, user_id=5727cf446229439c95f2c9b33a2f030c, role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:01.885876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaaf37-fabf-4461-a6e8-eff7e97d1b73 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:02.008907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 512/1019] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:01 2022] PUT /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77/users/5727cf446229439c95f2c9b33a2f030c/roles/f64957bf427046ef80071913d3681efc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:04.253662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9473-8229-4d3d-bd8c-df742bb0ee76 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.254242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9473-8229-4d3d-bd8c-df742bb0ee76 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.254515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9473-8229-4d3d-bd8c-df742bb0ee76 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.257701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 508/1020] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:04.266105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.266637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.266775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.290421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:04.291654 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:04.353133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 513/1021] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:04.378754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9473-8229-4d3d-bd8c-df742bb0ee76 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:04.391541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9473-8229-4d3d-bd8c-df742bb0ee76 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:04.396944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:04.397719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.397995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.398265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] PATH_INFO: `/v3/roles/f64957bf427046ef80071913d3681efc` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.399780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] RBAC: Authorizing `identity:get_role(role_id=f64957bf427046ef80071913d3681efc)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:04.401399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:04.402755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 509/1022] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:04 2022] GET /identity/v3/roles/f64957bf427046ef80071913d3681efc => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:04.411673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:04.421338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e9a8-080e-4e4e-9544-51d05dae1dc9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:04.427699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:04.428701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.428967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.429254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] PATH_INFO: `/v3/users/5727cf446229439c95f2c9b33a2f030c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.430530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=5727cf446229439c95f2c9b33a2f030c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:04.432764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:04.434436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 514/1023] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:04 2022] GET /identity/v3/users/5727cf446229439c95f2c9b33a2f030c => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:04.441374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:04.451437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79587bb-4524-415b-9206-62d345f5ead8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:04.456711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:04.457348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.457633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.457915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.468078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:04.470530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:04.480889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 510/1024] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:04.490916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:04.506842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50d80-0884-4818-bd10-e8d479036cd7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:04.513631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:04.514990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.515880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.516569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.518796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:04.521852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b187d9c-1ac8-4f72-bcba-41e0104c9a68 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:04.523951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 515/1025] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:04 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:04.533666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:04.543737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b09e-a51e-4581-bcf1-15189ea5e52a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:04.549901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:04.550549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:04.550826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:04.551103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:04.551921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] RBAC: Adding query filter params (role.id=f64957bf427046ef80071913d3681efc, scope.project.id=81bf56c01e914cdfa1a63a03503dde77, user.id=5727cf446229439c95f2c9b33a2f030c) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:04.552262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:04.554088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab2f7-6a8d-4fad-9da2-c04c4bda470f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:04.560720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 511/1026] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:04 2022] GET /identity/v3/role_assignments?user.id=5727cf446229439c95f2c9b33a2f030c&scope.project.id=81bf56c01e914cdfa1a63a03503dde77&role.id=f64957bf427046ef80071913d3681efc => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:06.881694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d7de-ea1d-4b57-abce-a37d31c9cc08 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:06.882463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d7de-ea1d-4b57-abce-a37d31c9cc08 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:06.882463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d7de-ea1d-4b57-abce-a37d31c9cc08 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:06.884012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 516/1027] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:06.894412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:06.894932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:06.895376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:06.921988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:06.923933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:06.936510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 512/1028] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:06 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:06.962728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d7de-ea1d-4b57-abce-a37d31c9cc08 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:06.977488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d7de-ea1d-4b57-abce-a37d31c9cc08 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:06.982131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:06.982921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:06.983203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:06.983476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:06.984963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:06.986829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13d1f2-1369-4a93-a51c-0694b5da5ebd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:06.988521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 517/1029] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:06.995306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:07.005496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d1e55-ea50-41e1-90bd-f767b60ea2a7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:07.018139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:07.018807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:07.019084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:07.019351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:07.020114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:07.022123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c5b6d-053b-4b9f-9f24-75332fee45f7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:07.124112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 513/1030] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:48:06 2022] POST /identity/v3/projects => generated 311 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:09.443889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e5dd-4f8d-4e74-afde-b795b18bdbae None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:09.444459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e5dd-4f8d-4e74-afde-b795b18bdbae None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:09.444572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e5dd-4f8d-4e74-afde-b795b18bdbae None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:09.446275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 518/1031] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:09.456735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd258b2-d671-4862-a729-109adab62508 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:09.457345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd258b2-d671-4862-a729-109adab62508 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:09.457345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd258b2-d671-4862-a729-109adab62508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:09.476284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bdd258b2-d671-4862-a729-109adab62508 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:09.477481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bdd258b2-d671-4862-a729-109adab62508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:09.539407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 514/1032] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:09.566342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e5dd-4f8d-4e74-afde-b795b18bdbae None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:09.578760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e5dd-4f8d-4e74-afde-b795b18bdbae None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:09.583466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:09.584292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:09.584578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:09.584850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:09.586016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:09.587706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe7da3-d5af-4370-878c-19bedda360b2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:09.589635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 519/1033] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:48:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:09.601027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd258b2-d671-4862-a729-109adab62508 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:09.613536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd258b2-d671-4862-a729-109adab62508 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:09.618521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:09.619211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:09.619528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:09.619840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:09.620616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:09.622559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0da9e-159c-4932-a6e6-ad0461d15d6f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:09.738466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 515/1034] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:48:09 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:12.007960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62566f-7088-4241-91e6-92ade0daffaa None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.008535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62566f-7088-4241-91e6-92ade0daffaa None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.008535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62566f-7088-4241-91e6-92ade0daffaa None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.010337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 520/1035] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:12.019297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.019792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.019882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.038280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:12.039486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:12.047440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 516/1036] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:12.072510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62566f-7088-4241-91e6-92ade0daffaa None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.086891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62566f-7088-4241-91e6-92ade0daffaa None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.091639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.092578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.092866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.093468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.104404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:12.111951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:12.113204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 521/1037] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:12.119933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.129944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c634-7c5c-483b-b588-2ca44e4e5a61 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.134924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.135615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.135899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.136206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.136961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:12.137265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:12.138879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:12.148494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 517/1038] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:12.156336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.166444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826ab5-8fce-43b7-9ba1-c1284bf7093b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.171070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.172386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.172759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.173035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] PATH_INFO: `/v3/users/259eca2ace3f486387f828f1e6be5403` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.186139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] RBAC: Authorizing `identity:get_user(user_id=259eca2ace3f486387f828f1e6be5403)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:12.189423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:12.191058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 522/1039] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/users/259eca2ace3f486387f828f1e6be5403 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:12.198244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.208157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd0890-3616-49c5-9160-dbfa267fb1e4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.212833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.213714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.213995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.214276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.222197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:12.223954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:12.233295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 518/1040] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:48:12.240603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.250904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459c9d-6da3-4e0f-895a-ee229f657b8f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.255497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.256367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.256800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.269561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] PATH_INFO: `/v3/projects/b5eebd726c6241a6be950750719ad294` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.269561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5eebd726c6241a6be950750719ad294)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:12.269561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5b859-7ae5-4bbb-8a5e-83be2ee2e297 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:12.269561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 523/1041] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/projects/b5eebd726c6241a6be950750719ad294 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:12.269904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:12.277695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d3f3d-440f-41b6-a31e-13b1bb69f8aa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:12.282570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:12.283195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:12.283475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:12.283749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:12.284614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=b5eebd726c6241a6be950750719ad294, user.id=259eca2ace3f486387f828f1e6be5403) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:12.284926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:12.286733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a371d-487e-4f80-81dc-2297da051a55 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:12.292226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 519/1042] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:12 2022] GET /identity/v3/role_assignments?user.id=259eca2ace3f486387f828f1e6be5403&scope.project.id=b5eebd726c6241a6be950750719ad294&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:14.508267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee162-2cdb-48a3-81e1-de1a0d7073a1 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.508808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee162-2cdb-48a3-81e1-de1a0d7073a1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.508808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee162-2cdb-48a3-81e1-de1a0d7073a1 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.510597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 524/1043] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:14.518854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.519295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.519411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.537538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:14.538750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:14.546480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 520/1044] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:14 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:14.570099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee162-2cdb-48a3-81e1-de1a0d7073a1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:14.582798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee162-2cdb-48a3-81e1-de1a0d7073a1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:14.587170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:14.588223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.588511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.588786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.600322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:14.607139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:14.608356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 525/1045] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:14.616192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:14.625539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e3ccc-0e05-4a9e-97ee-14391c2e3983 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:14.630152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:14.630803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.631081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.631352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.632132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:14.632435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:14.634002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:14.642929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 521/1046] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:14.649884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:14.662963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073534d6-7021-49c1-8271-eca26f852734 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:14.667751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:14.668625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.668909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.669182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] PATH_INFO: `/v3/users/259eca2ace3f486387f828f1e6be5403` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.670373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] RBAC: Authorizing `identity:get_user(user_id=259eca2ace3f486387f828f1e6be5403)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:14.672913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:14.674519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 526/1047] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:14 2022] GET /identity/v3/users/259eca2ace3f486387f828f1e6be5403 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:14.681107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:14.691873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7edd7-db1d-4015-91b0-9b706e9a6e2d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:14.696568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:14.697407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.697686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.697956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] PATH_INFO: `/v3/projects/b5eebd726c6241a6be950750719ad294` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.699113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] RBAC: Authorizing `identity:get_project(project_id=b5eebd726c6241a6be950750719ad294)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:14.701174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be564136-8b09-45da-b0c7-55e6ff8f366d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:14.703677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 522/1048] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:14 2022] GET /identity/v3/projects/b5eebd726c6241a6be950750719ad294 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:14.710637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:14.720731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca51c81-19cb-4e41-b15c-d9c656f0602e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:14.725330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:14.726558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:14.726841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:14.727119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] PATH_INFO: `/v3/projects/b5eebd726c6241a6be950750719ad294/users/259eca2ace3f486387f828f1e6be5403/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:14.729104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5eebd726c6241a6be950750719ad294, user_id=259eca2ace3f486387f828f1e6be5403, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:14.731705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c00d1-9d55-48d6-ad64-020e60cb6aee admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:14.868761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 527/1049] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:14 2022] PUT /identity/v3/projects/b5eebd726c6241a6be950750719ad294/users/259eca2ace3f486387f828f1e6be5403/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:17.106472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5878-332a-47f7-95f2-a5b9ce1694bc None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.107080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5878-332a-47f7-95f2-a5b9ce1694bc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.107080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5878-332a-47f7-95f2-a5b9ce1694bc None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.109601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 523/1050] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:17.117440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.118407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.118407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.137648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:17.139092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:17.197202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 528/1051] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:17.223471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb5878-332a-47f7-95f2-a5b9ce1694bc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.237007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb5878-332a-47f7-95f2-a5b9ce1694bc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.241363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.242165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.242518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.242797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.253914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:17.260699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:17.261885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 524/1052] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:17.269142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.278332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9bad-e5d2-407a-b46f-95557f882ab7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.284562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.285217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.285509 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.285782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.286538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:17.286857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:17.288583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:17.297994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 529/1053] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:17.304474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.315288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9647ec-3093-44fc-965d-73fcfc769ca7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.319831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.320711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.320992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.321265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] PATH_INFO: `/v3/users/259eca2ace3f486387f828f1e6be5403` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.322465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] RBAC: Authorizing `identity:get_user(user_id=259eca2ace3f486387f828f1e6be5403)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:17.324601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:17.326362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 525/1054] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/users/259eca2ace3f486387f828f1e6be5403 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:17.333833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.344794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2dfdc-1643-45b0-b6b0-a0e228d98613 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.349277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.349904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.350182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.350454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.358226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:17.360160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:17.368800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 530/1055] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:17.375837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.385988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc4ff-2965-4b6c-a4d5-71d85f069aab admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.391422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.392311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.392590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.392860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] PATH_INFO: `/v3/projects/b5eebd726c6241a6be950750719ad294` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.394036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] RBAC: Authorizing `identity:get_project(project_id=b5eebd726c6241a6be950750719ad294)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:17.396103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c30b-9368-4f2f-a942-2a97d828259a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:17.397786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 526/1056] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/projects/b5eebd726c6241a6be950750719ad294 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:17.404798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:17.414701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed500834-af0b-4742-9dc0-3dd6afad536b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:17.419350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:17.420020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:17.420330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:17.420589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:17.421705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=b5eebd726c6241a6be950750719ad294, user.id=259eca2ace3f486387f828f1e6be5403) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:17.422217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:17.424040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3932839-61ef-4435-a155-d50f35b5d2b1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:17.430165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 531/1057] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:17 2022] GET /identity/v3/role_assignments?user.id=259eca2ace3f486387f828f1e6be5403&scope.project.id=b5eebd726c6241a6be950750719ad294&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:19.680592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90c72-e2d1-4eae-ab58-aa3417712a81 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:19.681175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90c72-e2d1-4eae-ab58-aa3417712a81 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:19.681175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90c72-e2d1-4eae-ab58-aa3417712a81 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:19.682918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 527/1058] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:19.691329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:19.691809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:19.691897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:19.709811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:19.710988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:19.719229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 532/1059] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:19.743135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90c72-e2d1-4eae-ab58-aa3417712a81 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:19.756799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90c72-e2d1-4eae-ab58-aa3417712a81 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:19.761437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:19.762078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:19.762360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:19.762631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:19.770834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:19.772644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:19.781526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 528/1060] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:19.788314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:19.798079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160baf-2bde-4828-b488-16d2b2416015 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:19.802676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:19.803455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:19.803731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:19.804027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:19.811262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:19.814210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:19.827551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-597f5930-e195-447a-9518-d9d9009c4d8a admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 28 01:48:19.828739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 533/1061] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:48:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:19.836008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:19.845509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b9c65-a980-4e7c-ab40-8efdb41945f9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:19.850405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:19.851047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:19.851332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:19.851646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:19.852339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:19.852647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:19.854221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc035fdd-d746-4bb7-8516-69bdfc08f922 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:19.862238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 529/1062] 10.222.0.79 () {56 vars in 1136 bytes} [Fri Jan 28 01:48:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:48:22.090744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffacf-5e47-415d-8c8b-8d70f32a8f77 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:22.091305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffacf-5e47-415d-8c8b-8d70f32a8f77 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:22.091305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaffacf-5e47-415d-8c8b-8d70f32a8f77 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:22.093939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 534/1063] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:22.101241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f692c-91df-452f-93a5-f97980e2d865 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:22.101695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f692c-91df-452f-93a5-f97980e2d865 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:22.101816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f692c-91df-452f-93a5-f97980e2d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:22.119564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e46f692c-91df-452f-93a5-f97980e2d865 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:22.120779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e46f692c-91df-452f-93a5-f97980e2d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:22.128571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 530/1064] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:22 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:22.153061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffacf-5e47-415d-8c8b-8d70f32a8f77 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:22.165821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaffacf-5e47-415d-8c8b-8d70f32a8f77 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:22.170152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:22.170823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:22.171107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:22.171373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:22.172149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:22.173159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:48:22.173159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 01:48:22.173159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 01:48:22.174031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f0133-1501-402d-96e2-0f262ead0937 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:22.298512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 535/1065] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Jan 28 01:48:22 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:48:24.505475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbd78-c80f-4647-8e05-c50c04e6b9db None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:24.506053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbd78-c80f-4647-8e05-c50c04e6b9db None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:24.506053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dbd78-c80f-4647-8e05-c50c04e6b9db None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:24.507785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 531/1066] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:24.515477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:24.516002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:24.516095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:24.535949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:24.537187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:24.595191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 536/1067] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:24.619778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dbd78-c80f-4647-8e05-c50c04e6b9db None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:24.635587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dbd78-c80f-4647-8e05-c50c04e6b9db None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:24.642017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:24.642867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:24.643389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:24.643532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] PATH_INFO: `/v3/domains/c8f9a619ddeb423fbe002609ef92e6c5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:24.656185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c8f9a619ddeb423fbe002609ef92e6c5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:24.658212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d10c7-e583-49a7-b4a7-001794e17367 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:24.659933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 532/1068] 10.222.0.79 () {56 vars in 1204 bytes} [Fri Jan 28 01:48:24 2022] GET /identity/v3/domains/c8f9a619ddeb423fbe002609ef92e6c5 => generated 267 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:24.666816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:24.677139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f071a-fbc8-4c07-932c-834d77f15f0b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:24.681702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:24.682356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:24.682640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:24.682916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:24.683631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:24.685586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df653ef-5f6d-40b6-88fb-ca3dd3b06299 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:24.794701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 537/1069] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:48:24 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:27.041162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a5c9-9299-443d-8fcb-b1942c6f4eea None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:27.041738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a5c9-9299-443d-8fcb-b1942c6f4eea None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:27.041738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a5c9-9299-443d-8fcb-b1942c6f4eea None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:27.043459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 533/1070] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:27.051803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:27.052304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:27.052407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:27.070588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:27.071776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:27.131984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 538/1071] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:27 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:48:27.159713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1a5c9-9299-443d-8fcb-b1942c6f4eea None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:27.172426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1a5c9-9299-443d-8fcb-b1942c6f4eea None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:27.177036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:27.177887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:27.178173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:27.178452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] PATH_INFO: `/v3/domains/c8f9a619ddeb423fbe002609ef92e6c5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:27.179624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c8f9a619ddeb423fbe002609ef92e6c5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:27.181706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ed93-3c53-4679-a479-4e425d30a04d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:27.183322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 534/1072] 10.222.0.79 () {56 vars in 1204 bytes} [Fri Jan 28 01:48:27 2022] GET /identity/v3/domains/c8f9a619ddeb423fbe002609ef92e6c5 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:27.190343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:27.199288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb11dfc-f4bc-4299-bca8-d05c52f947a4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:27.204597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:27.205245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:27.205527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:27.205800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:27.206498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:27.208466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a8f7e-6ce1-4572-9c62-50014df2f25e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:27.300330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 539/1073] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:48:27 2022] POST /identity/v3/users => generated 311 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:48:29.534495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dde1-f38f-45aa-9130-390effd89880 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.535035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dde1-f38f-45aa-9130-390effd89880 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.535441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dde1-f38f-45aa-9130-390effd89880 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.538717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 535/1074] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:48:29.548151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.548844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.549119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.577243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:29.579300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:29.589933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 540/1075] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:29.615514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743dde1-f38f-45aa-9130-390effd89880 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.629316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743dde1-f38f-45aa-9130-390effd89880 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.633728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.634506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.634791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.635065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.647001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:29.653806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:29.655652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 536/1076] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:29.662777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.672025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40e09f-2da6-40db-aca0-b4da0c9f407b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.676689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.677364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.677650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.677929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.678681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:29.678991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:29.680648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:29.690239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 541/1077] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:29.696759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.707354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4207574-8b0e-4654-aa2d-8b9bb49f6ea3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.711841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.712974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.713253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.713521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] PATH_INFO: `/v3/users/8ae7314ee7bc43fab15d1869595c43f0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.727051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ae7314ee7bc43fab15d1869595c43f0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:29.729208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:29.730829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 537/1078] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/users/8ae7314ee7bc43fab15d1869595c43f0 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:29.737588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.747461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18f9af-045a-421d-95a8-22ca06a5b41b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.753020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.753655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.753937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.754213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.761996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:29.763767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:29.773508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 542/1079] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:29.780189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.790616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0d1c-8648-427d-9811-6cb8c04ed068 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.795755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.796805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.796972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.797243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] PATH_INFO: `/v3/projects/18019db455ea42be8fb36a25e64c1971` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.798411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] RBAC: Authorizing `identity:get_project(project_id=18019db455ea42be8fb36a25e64c1971)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:29.800457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6e76-a7ad-4ff2-98ef-4a22b7179b7e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:29.802113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 538/1080] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/projects/18019db455ea42be8fb36a25e64c1971 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:29.808689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:29.818264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b7fdf0-8726-4569-ab26-630a350e10ad admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:29.822787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:29.823417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:29.823700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:29.823997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:29.824823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=18019db455ea42be8fb36a25e64c1971, user.id=8ae7314ee7bc43fab15d1869595c43f0) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:29.825135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:29.827858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1523b02-fd0c-4f97-a7e1-b03e870e8cc1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:29.833360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 543/1081] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:29 2022] GET /identity/v3/role_assignments?user.id=8ae7314ee7bc43fab15d1869595c43f0&scope.project.id=18019db455ea42be8fb36a25e64c1971&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:32.012587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95499c-ba9e-4869-adbc-166c76be1bc7 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.013204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95499c-ba9e-4869-adbc-166c76be1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.013291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95499c-ba9e-4869-adbc-166c76be1bc7 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.015115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 539/1082] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:32.022359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.022786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.022916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.041811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:32.043009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:32.051391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 544/1083] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:32.074896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95499c-ba9e-4869-adbc-166c76be1bc7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.087524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95499c-ba9e-4869-adbc-166c76be1bc7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.093173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.093602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.093888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.094166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.104554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:32.111885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:32.113153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 540/1084] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:32.122322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.136959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339282-6f00-4e39-961b-04a6ef024cc9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.142674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.143341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.143628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.143906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.144687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:32.144998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.146591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.155668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 545/1085] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:32.162589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.173954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7de8c4-0873-40d4-9339-932cc5342cec admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.178591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.179433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.179713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.180022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] PATH_INFO: `/v3/users/8ae7314ee7bc43fab15d1869595c43f0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.181738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ae7314ee7bc43fab15d1869595c43f0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.185821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.187647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 541/1086] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/users/8ae7314ee7bc43fab15d1869595c43f0 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:32.194835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.210086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a274f1-f04a-4fef-be49-db37ba36836f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.214982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.215816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.216124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.216393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] PATH_INFO: `/v3/projects/18019db455ea42be8fb36a25e64c1971` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.218218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] RBAC: Authorizing `identity:get_project(project_id=18019db455ea42be8fb36a25e64c1971)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.220278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b07230-0d8d-4403-a859-284d4f1c1514 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.221927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 546/1087] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:32 2022] GET /identity/v3/projects/18019db455ea42be8fb36a25e64c1971 => generated 361 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:32.228581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:32.239185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64001c-f290-4592-846f-6abd8a6cd7d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:32.243755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:32.244648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:32.244928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:32.245200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] PATH_INFO: `/v3/projects/18019db455ea42be8fb36a25e64c1971/users/8ae7314ee7bc43fab15d1869595c43f0/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:32.247182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18019db455ea42be8fb36a25e64c1971, user_id=8ae7314ee7bc43fab15d1869595c43f0, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:32.249832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1a2ac-e831-493e-b228-1c9fde289511 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:32.359817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 542/1088] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:48:32 2022] PUT /identity/v3/projects/18019db455ea42be8fb36a25e64c1971/users/8ae7314ee7bc43fab15d1869595c43f0/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:48:34.575829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d97a2-a552-4723-b876-dd9c6c8fea56 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.576500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d97a2-a552-4723-b876-dd9c6c8fea56 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.576640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d97a2-a552-4723-b876-dd9c6c8fea56 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.580110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 547/1089] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:48:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:48:34.595441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.596307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.596506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.618391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:48:34.619751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:48:34.702113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 543/1090] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:48:34 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:48:34.728422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d97a2-a552-4723-b876-dd9c6c8fea56 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.743461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d97a2-a552-4723-b876-dd9c6c8fea56 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.749117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.750014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.750297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.750574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.764109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:48:34.771960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:48:34.773311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 548/1091] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:48:34.781030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.792552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fb015-77b1-459f-8bd4-bd0a7cf5aec2 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.800222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.801605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.802154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.802708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.804385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:34.805003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:34.808567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:34.827505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 544/1092] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:34.837069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.850316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a9a41-1b6a-4273-b473-ad31ee2a5f00 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.855784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.856911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.857788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.858728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] PATH_INFO: `/v3/users/8ae7314ee7bc43fab15d1869595c43f0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.860881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] RBAC: Authorizing `identity:get_user(user_id=8ae7314ee7bc43fab15d1869595c43f0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:34.863290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:34.865328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 549/1093] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/users/8ae7314ee7bc43fab15d1869595c43f0 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:34.874956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.886948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac32216-81b0-426a-b16c-1e7fa27e38d6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.893340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.894024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.894310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.894590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.904538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:34.906514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:34.917258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 545/1094] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:48:34.925063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.934846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002215cb-1004-4ae5-b96c-bed23018cbef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.940736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.941567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.941846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.942153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] PATH_INFO: `/v3/projects/18019db455ea42be8fb36a25e64c1971` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.943427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] RBAC: Authorizing `identity:get_project(project_id=18019db455ea42be8fb36a25e64c1971)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:34.945672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be27a8-e3f4-4deb-abbd-02de5862c813 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:34.947419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 550/1095] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/projects/18019db455ea42be8fb36a25e64c1971 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:48:34.954676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:48:34.964365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8b4e3-2f0a-45c5-994f-14d611915903 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:48:34.969843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:48:34.970510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:48:34.970816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:48:34.971115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:48:34.972030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=18019db455ea42be8fb36a25e64c1971, user.id=8ae7314ee7bc43fab15d1869595c43f0) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:48:34.972356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:48:34.974400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d72c4-6b08-47d0-8d47-63ce30bf1627 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:48:34.980964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 546/1096] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:48:34 2022] GET /identity/v3/role_assignments?user.id=8ae7314ee7bc43fab15d1869595c43f0&scope.project.id=18019db455ea42be8fb36a25e64c1971&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:49.717340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16697-54bc-4d72-bcdb-ca334e95325a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.717930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16697-54bc-4d72-bcdb-ca334e95325a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.717930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b16697-54bc-4d72-bcdb-ca334e95325a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.719682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 551/1097] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:49.727455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.728912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.728912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.745574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:49.746817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:49.755305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 547/1098] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:49.782485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b16697-54bc-4d72-bcdb-ca334e95325a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.795149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b16697-54bc-4d72-bcdb-ca334e95325a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.799949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.802875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.802875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.802875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.812107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.814760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.832559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:49.833748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 552/1099] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:49.840739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.850131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f8b2-ddbc-42ee-9cf7-54a13716a7e1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.854700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.855355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.855634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.855906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.860998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:49.860998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.860998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d63ad-54b3-45c1-8d24-53d9eb480e18 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:49.877584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 548/1100] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:49.883675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:49.893873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e61962-50a6-4498-8ab7-2a18f57c7233 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:49.898523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:49.899180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:49.899463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:49.899736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:49.900475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:49.902369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0767-7957-4c4b-84eb-902c67129fb8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:50.009934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 553/1101] 10.222.0.79 () {60 vars in 1153 bytes} [Fri Jan 28 01:49:49 2022] POST /identity/v3/users => generated 251 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:49:52.326455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666bb1a-93fd-4e33-862b-7e2ce8890015 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.327021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666bb1a-93fd-4e33-862b-7e2ce8890015 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.327021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666bb1a-93fd-4e33-862b-7e2ce8890015 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.328793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 549/1102] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:52.336223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.336666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.336788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.355569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:52.356811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:52.365248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 554/1103] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:52 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:52.390450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666bb1a-93fd-4e33-862b-7e2ce8890015 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.402971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666bb1a-93fd-4e33-862b-7e2ce8890015 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.407351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.408422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.408775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.408984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.419855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:52.427478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:52.428685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 550/1104] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.435388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.445377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab9a2c-d743-4a6d-b6cb-2285fd6812f1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.450090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.450742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.451023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.451304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.452070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.452376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.453968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.462412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 555/1105] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.469101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.479504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a836d1-38a2-4069-9bd2-f08f090dfed8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.484289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.485066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.485984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.486274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.496877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.498723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.516620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:52.517882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 551/1106] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.524442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.535279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb268c-df60-47b9-bf44-ba6f3e910250 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.540104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.540748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.541029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.541303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.542018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.542322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.543903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.556502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 556/1107] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.563110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.572852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d98f3-559e-4091-832b-5c20ce4b91f6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.577440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.578213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.578487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.578756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.585947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.588012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.602582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:49:52.603778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 552/1108] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.611059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.621315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76f41f-170e-4e81-9fe7-a602637a8b14 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.626785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.627477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.627762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.628076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.628907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.629218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.631674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.650273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 557/1109] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:52.657038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.667346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e7fea-2ed4-4745-a91d-6fb3ee851230 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.671843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.672512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.672862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.673660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.681643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.683445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.692577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 553/1110] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:52.699253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.709583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bc373-0b54-4c10-91df-582bed869025 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.714516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.715550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.715837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.716157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.727283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.729294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.746706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:52.747863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 558/1111] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.754475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.763382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b2246-f067-462b-a164-82b69808bc4a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.768474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.769233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.769457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.769727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.770429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.770729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.772315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.786543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 554/1112] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.792916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.803527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102b92f-2ed5-409f-b6fd-4a211f2f3ccd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.808180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.808844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.809126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.809399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.816695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.818731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.832337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:52.833484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 559/1113] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:52.840334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.850798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23a66e-874d-4b0b-a662-a27445767457 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.855517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.856351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.856701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.856794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.857571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.857879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.859699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef673e8-087b-40f6-a446-40f24bba7e65 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.873171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 555/1114] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:52.880169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:52.890540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d26e3-286a-4e84-95a5-ecba50debe08 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:52.895805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:52.896491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:52.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:52.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:52.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=37e4ba18870847e8bf97f9ed25771af9) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:52.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:52.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da623f3-c160-432f-9b04-ba24984ca587 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:52.905704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 560/1115] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:52 2022] GET /identity/v3/role_assignments?user.id=37e4ba18870847e8bf97f9ed25771af9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:55.135783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6f3e-2776-4951-ae5f-34bee44e6683 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.136361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6f3e-2776-4951-ae5f-34bee44e6683 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.136361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e6f3e-2776-4951-ae5f-34bee44e6683 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.138195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 556/1116] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:55.148104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.148104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.148104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.165033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:55.167466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:55.174811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 561/1117] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:49:55.199188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e6f3e-2776-4951-ae5f-34bee44e6683 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.212145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e6f3e-2776-4951-ae5f-34bee44e6683 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.216937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.217705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.217986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.218258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.229174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:55.236758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:55.239177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 557/1118] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:55.244874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.254646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a38e-c7b7-4f36-9c0e-a92266853937 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.259181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.259829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.260150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.260426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.261161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:55.261609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.263191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.271320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 562/1119] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:55.277776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.288350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e7603-bf9f-40c0-9ca3-490183d10757 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.292961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.293718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.294001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.294276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.304913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.306811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.323961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:55.325192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 558/1120] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:55.331815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.342094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32cadc-4f8f-4a38-be94-aadd36b24761 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.346756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.347400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.347685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.347962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.348783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:55.349090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.350688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.363413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 563/1121] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:55.369802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.380160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a5a03-a88d-49cf-b67c-7f75462ee8f2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.384800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.385581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.385914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.386205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.393391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.395410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.409052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:49:55.410182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 559/1122] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:55.416599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.427017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1732c-a941-4052-8aef-8014ca87d910 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.431523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.432214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.432497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.432772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.433599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:55.433909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.435753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.457749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 564/1123] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:55.464077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.475012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c91ee6-522f-47e8-a84d-70b7b282aa69 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.480551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.481077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.481077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.484944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.492027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.493886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.510824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:55.512064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 560/1124] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:55.519490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.529187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de6694-108a-461c-8491-0344a435d371 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.533772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.534420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.534697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.534975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.535680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:55.536012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.537588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.549023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 565/1125] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:55.555224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.565400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfde2e-3688-4dc1-80ce-4c393a734672 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.569939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.570701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.570979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.571249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.580592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.582512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.595802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:55.596982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 561/1126] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:55.603425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.613561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeec93-0447-4591-80c0-753b425db68b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.618118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.618771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.619054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.619329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.620251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:55.620566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.622404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478898c-17b4-40a6-8957-357d1ddde339 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.636030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 566/1127] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:55.643898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:55.654794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791056f-02ae-43b6-bde1-661d41718970 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:55.659555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:55.660498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:55.660776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:55.661049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/37e4ba18870847e8bf97f9ed25771af9/roles/1cf887da8c384ae2b68e9a16c907f584` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:55.675873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=37e4ba18870847e8bf97f9ed25771af9, role_id=1cf887da8c384ae2b68e9a16c907f584)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:55.678691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e743b-4d96-498f-89a1-eb887216059f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:55.799327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 562/1128] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:49:55 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/37e4ba18870847e8bf97f9ed25771af9/roles/1cf887da8c384ae2b68e9a16c907f584 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:49:58.022158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbe83c-5874-46ca-8f0e-4397798ef579 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.022725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbe83c-5874-46ca-8f0e-4397798ef579 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.022725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbe83c-5874-46ca-8f0e-4397798ef579 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.024580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 567/1129] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:49:58.032996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.033547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.033547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.051334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:49:58.052636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:49:58.121316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 563/1130] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:49:58 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:49:58.143282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbe83c-5874-46ca-8f0e-4397798ef579 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.155349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbe83c-5874-46ca-8f0e-4397798ef579 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.160365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.161157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.161432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.161697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.172207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:49:58.178995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:49:58.180213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 568/1131] 10.222.0.79 () {56 vars in 1123 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:58.186903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.196230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f21f3-03ae-4336-add6-9fd5fbbccae9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.200885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.204608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.204608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.204608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.204608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.204608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.205285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.213733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 564/1132] 10.222.0.79 () {56 vars in 1124 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:58.221191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.241507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d1027-6142-4222-ac7e-026319922814 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.246381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.247163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.247446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.247720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.259039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.261022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.283616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:58.283616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 569/1133] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:58.286963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.297105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7ace-5be9-47d7-886a-2d1aa4064090 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.303174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.306664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.306664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.306664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.306664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.306664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.307065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.319585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 565/1134] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:58.326055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.336587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a71a45-3dd5-43e0-b56c-441a4d63567d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.341375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.342165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.342439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.342706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.352595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.354615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.368129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:49:58.369277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 570/1135] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:58.375800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.385761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53a8fe-80c4-486e-a8e4-1361c3792e40 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.390695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.391296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.392250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.392593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.393427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.393732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.395627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.414141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 566/1136] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:49:58.420610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.430676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e0a3c-050c-4502-aa89-57292660f5da admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.435221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.435851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.436177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.436455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.444474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.446217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.456164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 571/1137] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:49:58.462811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.473839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de9608-bc6f-48a4-b8b9-b2a5a1a350d2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.478547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.481214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.481214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.481214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.490953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.492835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.511137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:49:58.512363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 567/1138] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:58.520954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.530353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6025b0-4263-496c-9ff2-e765f98432b4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.535579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.536233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.536517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.536792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.537515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.537818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.539411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.554045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 572/1139] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:58.560524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.571477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331b327-f3a7-484d-83de-916afeb30d07 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.576817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.577607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.577888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.578165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.586334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.588348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.602037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:49:58.603405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 568/1140] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:49:58.610133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.620380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771b36-e9bf-4df9-a65a-6b6da13a12df admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.624911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.625554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.626324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.626759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.627687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.628023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.629856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b01a47-7803-4bf2-b786-644e22fa4d1a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.641449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 573/1141] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:49:58.648785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:49:58.659577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e76058-355e-41b2-9ca8-8faf2df4089e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:49:58.665891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:49:58.665891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:49:58.665891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:49:58.665891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:49:58.666393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] RBAC: Adding query filter params (role.id=1cf887da8c384ae2b68e9a16c907f584, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=37e4ba18870847e8bf97f9ed25771af9) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:49:58.666603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:49:58.668468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53542-6336-4a06-94ca-d247957862dc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:49:58.674426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 569/1142] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:49:58 2022] GET /identity/v3/role_assignments?user.id=37e4ba18870847e8bf97f9ed25771af9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=1cf887da8c384ae2b68e9a16c907f584 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:00.955306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f857f-aba3-46dc-8a91-65187e1e8e13 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.955876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f857f-aba3-46dc-8a91-65187e1e8e13 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.955876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f857f-aba3-46dc-8a91-65187e1e8e13 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.957725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 574/1143] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:00.965535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:00.965960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:00.966116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:00.984099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:00.985992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:00.994529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 570/1144] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:00 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:01.019953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f857f-aba3-46dc-8a91-65187e1e8e13 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.033420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f857f-aba3-46dc-8a91-65187e1e8e13 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.044787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.045578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.045861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.046141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.058043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:01.064841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:01.066035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 575/1145] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:01.072895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.082593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f8b19-506b-4187-85a8-0fe7c0903f65 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.087913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.088594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.088879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.089170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.090138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.090448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.092203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.101215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 571/1146] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:01.107527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.118677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111569e-7132-4904-ac09-43fed5092fa7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.123804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.124492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.124776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.125049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.135436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.138174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.155440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:01.156982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 576/1147] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:01.164068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.174205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91ff4-a258-4825-827f-d7bd8ad8b46d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.179159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.179807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.180120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.180392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.181107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.181411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.182982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.195429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 572/1148] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:01.201834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.212373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4465b-cfa4-4f34-ba18-dd27f6f041d7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.217428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.218215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.218490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.218754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.227240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.229290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.243165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:50:01.244434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 577/1149] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:01.250941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.261273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669e647-7dfb-420b-83da-f99ee8a0ef68 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.265861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.267175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.267496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.267765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.268633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.271618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.271618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.288599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 573/1150] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:01.294988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.304661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa810a-a116-4431-ab33-55e30b4062c1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.309572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.310203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.310486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.310762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.318686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.320471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.329650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 578/1151] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:01.336382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.347076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b039fe8-71a9-44bc-8bbe-23df49158c15 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.351727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.352531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.352818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.353102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.363454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.369206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.381875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:01.383017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 574/1152] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:50:01.389585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.398968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ad73-5a12-48ae-a87b-f2334b77b52a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.403674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.404338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.404621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.404894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.405598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.405899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.408259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.419628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 579/1153] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:01.426126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.435830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81ab-dafc-41a8-bace-80d5af76c29a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.441121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.441905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.442189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.442466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.449593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.451538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.465232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:01.466455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 575/1154] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:01.473610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.483154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa1ec0-f14c-496c-b2b8-2458bd91b6cb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.488160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.488802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.489133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.489414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.490190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.490501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.492360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e504d-7975-4fbe-81a5-7acd0a7c153e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.504996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 580/1155] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:01.511669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:01.522799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5ef93-054d-48b1-8122-adcd66ffcc92 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:01.528314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:01.528314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:01.528509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:01.528624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:01.529445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=37e4ba18870847e8bf97f9ed25771af9) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:01.529756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:01.531569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e593-041b-44c3-9a50-63d7606990df admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:01.538304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 576/1156] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:01 2022] GET /identity/v3/role_assignments?user.id=37e4ba18870847e8bf97f9ed25771af9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:03.754015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07fe98-77b4-4cf0-b612-0661c9ba21ef None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.754593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07fe98-77b4-4cf0-b612-0661c9ba21ef None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.754593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07fe98-77b4-4cf0-b612-0661c9ba21ef None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.756418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 581/1157] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:03.765805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.766942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.767126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.788279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:03.789485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:03.797300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 577/1158] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:03 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:03.821508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07fe98-77b4-4cf0-b612-0661c9ba21ef None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.836023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07fe98-77b4-4cf0-b612-0661c9ba21ef None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.841146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.841853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.842134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.842407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.858250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:03.865989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:03.867282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 582/1159] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:03.876871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.886145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba36039-552e-4e93-80e7-161da5150706 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.890886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.891594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.891924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.892232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.893053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:03.893356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.895023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.903178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 578/1160] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:03.910920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.921461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ca1c8-8906-44fa-b51e-39afc0c86155 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.926769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.927533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.927821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.928137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.938780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.940802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:03.963380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:03.964679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 583/1161] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:03.972045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:03.982406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ad01c-8783-4cc4-a81a-c8d86668432f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:03.987947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:03.988670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:03.988958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:03.989237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:03.989965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:03.990278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:03.991865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.004529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 579/1162] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:04.010914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.021140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d69d6-7111-49f7-adc7-7b4c157aa729 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.025669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.026473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.026746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.038342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.038342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.038342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.053816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:50:04.055092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 584/1163] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:04.061677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.072505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bed6d-489a-4f11-894b-49e77a13c807 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.077171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.077833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.078113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.078388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.079253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:04.079560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.081430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.099516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 580/1164] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:04.105788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.116333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e66be-a55e-4902-84ec-668a5476bd4d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.121028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.122126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.122126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.122482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.140562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.144882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.164218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:04.165476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 585/1165] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:04.171795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.181819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d43e-8716-4d52-afa9-449bd3d84fd6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.186330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.186971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.193072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.193072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.193072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:04.193072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.193072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.201365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 581/1166] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:04.208322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.218485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0736e17-1e3e-444d-b337-7719620f92ab admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.224442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.225206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.227465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.227465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.232637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.234569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.247423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:04.248586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 586/1167] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:04.256684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.264963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169ace6-4414-4b13-9fc4-91523c102357 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.270523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.271208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.271486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.271760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.272564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:04.272871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.274691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff71d6a-b2db-46d2-b329-fa598b767d79 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.287556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 582/1168] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:04.294040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:04.305286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff18d72-c0d9-4b45-9fc1-4b2435cb2853 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:04.309794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:04.310640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:04.310916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:04.311183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] PATH_INFO: `/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/37e4ba18870847e8bf97f9ed25771af9/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:04.313116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d796d5575de4460e8b6746aa9eba151d, user_id=37e4ba18870847e8bf97f9ed25771af9, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:04.315829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e162-0dbf-4b19-b675-f4c6ae2f90ab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:04.425399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 587/1169] 10.222.0.79 () {58 vars in 1460 bytes} [Fri Jan 28 01:50:04 2022] PUT /identity/v3/projects/d796d5575de4460e8b6746aa9eba151d/users/37e4ba18870847e8bf97f9ed25771af9/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:50:06.633167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a545a8-d6f8-4760-98fe-9340d4f6b5ea None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.633861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a545a8-d6f8-4760-98fe-9340d4f6b5ea None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.633861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a545a8-d6f8-4760-98fe-9340d4f6b5ea None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.635546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 583/1170] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:06.643230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.643726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.643992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.662350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:06.663743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:06.728899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 588/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:06 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:06.754134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a545a8-d6f8-4760-98fe-9340d4f6b5ea None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.770678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a545a8-d6f8-4760-98fe-9340d4f6b5ea None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.777038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.777859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.778142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.778423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.790162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:50:06.796991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:50:06.798237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 584/1172] 10.222.0.79 () {56 vars in 1117 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:06.805818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.814925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e53e2a-2bbd-4c6d-a343-5a4f77516d8b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.819491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.820177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.820463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.820739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.821478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:06.821786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.823650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.832154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 589/1173] 10.222.0.79 () {56 vars in 1120 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:06.838900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.850227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc80f-49d4-4d3c-9381-a40162f05111 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.855072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.855853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.856222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.856493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.867872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.869714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.885888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:06.887010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 585/1174] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:06.893782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.903537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d481d6-c86b-4d53-a256-d4022e7eba94 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.908209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.909450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.909762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.910036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.910792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:06.911048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.912680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.925083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 590/1175] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:06.931541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.941515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff468c-4aea-4a5b-8853-c46ec4b9e664 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.946095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.946933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.950338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.950338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.955146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.957365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:06.972398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:50:06.973579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 586/1176] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:06.980225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:06.990926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef8816-2886-42c6-83c9-504493ba5e19 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:06.995403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:06.996170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:06.996446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:06.996714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:06.997616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:06.997917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:06.999738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.016632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 591/1177] 10.222.0.79 () {56 vars in 1164 bytes} [Fri Jan 28 01:50:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:07.023332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.033959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2568d6c-7acb-4502-b09c-da2b4012fb12 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.039746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.042610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.042610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.042610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.050926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.052705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.062038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 587/1178] 10.222.0.79 () {58 vars in 1324 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:50:07.069288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.080870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af384-2f10-4d73-a64a-cf5fd1c33aa7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.085693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.086474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.086757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.087032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.099634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.101581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.119073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:50:07.120357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 592/1179] 10.222.0.79 () {56 vars in 1129 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:07.126758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.136839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b041-3ec2-402a-843a-6f930fcdb235 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.141914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.143245 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.143360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.143580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.144330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:07.144629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.146361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.162420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 588/1180] 10.222.0.79 () {56 vars in 1130 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:07.168848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.179067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf94e2d-c3d0-47da-be40-26a9b6b80608 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.183863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.184730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.185398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.185398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.193202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.195198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.209803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING keystone.server.flask.application [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:50:07.211036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 593/1181] 10.222.0.79 () {56 vars in 1132 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:07.218628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.230538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b28387-2dab-4e69-b7fc-dbe0047131e4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.235308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.235964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.236263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.236536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.237392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:07.237741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.239576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a4d3-7033-4f58-90d0-a939b559f2a0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.253150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 589/1182] 10.222.0.79 () {56 vars in 1169 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:07.264084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:07.281908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358d819-2727-4f3c-a5ee-5a11d436938f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:07.287608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:07.288303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:07.288585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:07.288861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:07.289684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] RBAC: Adding query filter params (role.id=696ce32a0d804992a93645d6906b0119, scope.project.id=d796d5575de4460e8b6746aa9eba151d, user.id=37e4ba18870847e8bf97f9ed25771af9) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:07.289990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:07.291829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282b982-9609-48fd-911f-aacd54860981 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:07.298131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 594/1183] 10.222.0.79 () {56 vars in 1395 bytes} [Fri Jan 28 01:50:07 2022] GET /identity/v3/role_assignments?user.id=37e4ba18870847e8bf97f9ed25771af9&scope.project.id=d796d5575de4460e8b6746aa9eba151d&role.id=696ce32a0d804992a93645d6906b0119 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:09.566060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3432c-2e98-4896-9352-67966e237a7a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.566612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3432c-2e98-4896-9352-67966e237a7a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.566612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3432c-2e98-4896-9352-67966e237a7a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.568433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 590/1184] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:09.575832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.576311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.576399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.594917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:09.596952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:09.604918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 595/1185] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:09.629568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3432c-2e98-4896-9352-67966e237a7a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.642575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3432c-2e98-4896-9352-67966e237a7a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.647313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.653971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.653971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.653971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.653971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.653971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.662748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:50:09.663887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 591/1186] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:09.670907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.680437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e835a78-76bc-411e-9378-af389aff28ea None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.685462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.686113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.686396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.686673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.687374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:09.687678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.689303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44b2e9-629e-4736-bc1c-e6f65e1c5d8a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.694778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 596/1187] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:09.701094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:09.711389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba89e7f-6fb5-4b5e-b440-be4f3c9c7a42 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:09.716188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:09.717650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:09.717650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:09.717650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] PATH_INFO: `/v3/services` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:09.718295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:09.718597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:09.721230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a9ff-b21a-454d-80f8-bee32223396f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:09.726249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 592/1188] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Jan 28 01:50:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:50:11.938400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fef96-0ff4-4537-a335-5c1dd79aaad3 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.938951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fef96-0ff4-4537-a335-5c1dd79aaad3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.938951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fef96-0ff4-4537-a335-5c1dd79aaad3 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.941405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 597/1189] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:11.949215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd7ec-ec1d-48ee-9a0e-32500ddb6438 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:11.949778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd7ec-ec1d-48ee-9a0e-32500ddb6438 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:11.949857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd7ec-ec1d-48ee-9a0e-32500ddb6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:11.969011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d49bd7ec-ec1d-48ee-9a0e-32500ddb6438 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:11.970241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d49bd7ec-ec1d-48ee-9a0e-32500ddb6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:11.978312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 593/1190] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:50:12.002967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fef96-0ff4-4537-a335-5c1dd79aaad3 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:12.015776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fef96-0ff4-4537-a335-5c1dd79aaad3 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:12.020970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:12.021628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:12.021916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:12.022190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:12.022924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:12.024563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb76-79bd-4b05-bdd8-ade705d5c849 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:12.085577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 598/1191] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Jan 28 01:50:12 2022] POST /identity/v3/services => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:50:14.327288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6879-a3a2-4676-94af-68b53557ff05 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.327901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6879-a3a2-4676-94af-68b53557ff05 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.327901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f6879-a3a2-4676-94af-68b53557ff05 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.329646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 594/1192] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:50:14.337034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.337468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.337585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.357744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:14.359941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:14.376877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 599/1193] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:14.400775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f6879-a3a2-4676-94af-68b53557ff05 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.413932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f6879-a3a2-4676-94af-68b53557ff05 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.418474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.419250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.419541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.419794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.420470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.422047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.433892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:50:14.435264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 595/1194] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:14.442139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.451310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfbce-4fd6-429a-8ab2-c0a6b12bb1bd None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.456298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.456945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.457228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.457524 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.458198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:14.458499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.460129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.465189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 600/1195] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:14.472621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.482505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458953d-04fd-483d-afa1-27cf6f39ee32 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.487920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.488589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.488903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.489181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.489964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] RBAC: Adding query filter params (interface=public, service_id=9be7f2a292324a588e45c57411931063, region_id=RegionOne) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:14.490277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.491896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f515c5-5d75-435d-aa31-edf59bcd166c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.497170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 596/1196] 10.222.0.79 () {56 vars in 1272 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/endpoints?service_id=9be7f2a292324a588e45c57411931063&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:14.503325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:14.512875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546681-aaf1-4b07-8995-03e41f9f8a74 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:14.517443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:14.518191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:14.518470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:14.518739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:14.519405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:14.521071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a974c-8530-4943-bec8-f0fbf6e93919 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:14.527709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 601/1197] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:50:14 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:50:16.729818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9608c-a753-4220-ab3e-3a3ed6d47255 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.730353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9608c-a753-4220-ab3e-3a3ed6d47255 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.730353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9608c-a753-4220-ab3e-3a3ed6d47255 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.732321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 597/1198] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:50:16.740558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.741058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.741150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.758632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:50:16.759804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:50:16.767665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 602/1199] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:50:16.792213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9608c-a753-4220-ab3e-3a3ed6d47255 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.805697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9608c-a753-4220-ab3e-3a3ed6d47255 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.810373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.811157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.811438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.811711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.812394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.814111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.825148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING keystone.server.flask.application [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:50:16.826306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 598/1200] 10.222.0.79 () {56 vars in 1138 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:50:16.833740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.843341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aee20-355d-470a-a98a-934a0eb99f42 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.848831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.849588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.849863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.850134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] PATH_INFO: `/v3/services` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.850829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:50:16.851130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.852750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da721e5-6490-437d-acf8-95e223d3ad1c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.857967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 603/1201] 10.222.0.79 () {56 vars in 1137 bytes} [Fri Jan 28 01:50:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:50:16.864509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:50:16.874486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94840e14-2162-4c0b-a329-be59ee2c3fd2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:50:16.879491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:50:16.880165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:50:16.880447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:50:16.880719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:50:16.881459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:50:16.883024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60a8d-8ce5-4390-8adc-b1cb6dddcb1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:50:16.977183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 599/1202] 10.222.0.79 () {60 vars in 1165 bytes} [Fri Jan 28 01:50:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:57:14.305463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:14.306393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:14.306879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:14.317404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92924-8c59-4fb3-abbd-42c784972ad3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:14.318825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92924-8c59-4fb3-abbd-42c784972ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:14.319846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb92924-8c59-4fb3-abbd-42c784972ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:14.324896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 604/1203] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:14 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:14.493739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4eb92924-8c59-4fb3-abbd-42c784972ad3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:14.495465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4eb92924-8c59-4fb3-abbd-42c784972ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:14.644727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 600/1204] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:14.670468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:14.672603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:14.843315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9c057-f029-46fa-89a2-5c0e6146aefc None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:14.966873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:14.968485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:14.969014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:14.969517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:14.970676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:14.972877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76345-bb48-4550-bb26-2cb1d3dac788 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:15.008914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 605/1205] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:57:14 2022] GET /identity/v3/projects => generated 2553 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:57:17.708454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4106a-41f7-433c-a610-36dece02213d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.709027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4106a-41f7-433c-a610-36dece02213d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.709027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4106a-41f7-433c-a610-36dece02213d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:17.712183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 601/1206] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:17.722043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5417c-54c2-47a0-9d94-5e7a82a5a332 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.722625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5417c-54c2-47a0-9d94-5e7a82a5a332 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.722625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5417c-54c2-47a0-9d94-5e7a82a5a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:17.800765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2bb5417c-54c2-47a0-9d94-5e7a82a5a332 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:17.801940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2bb5417c-54c2-47a0-9d94-5e7a82a5a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:17.916394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 606/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:17.969338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.969625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.969903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:17.971682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 602/1208] 10.222.0.79 () {54 vars in 963 bytes} [Fri Jan 28 01:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:17.977945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45cd-5212-45cd-82dd-1898fd50c3ca None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:17.978228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45cd-5212-45cd-82dd-1898fd50c3ca None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:17.978519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45cd-5212-45cd-82dd-1898fd50c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.060327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-030d45cd-5212-45cd-82dd-1898fd50c3ca None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:18.061538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-030d45cd-5212-45cd-82dd-1898fd50c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.146042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 607/1209] 10.222.0.79 () {58 vars in 1060 bytes} [Fri Jan 28 01:57:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:18.157220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:18.159026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.268721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a496d5-65c0-4771-9715-6edb8165071c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:18.348492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:18.349102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:18.349427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:18.349721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:18.351565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:18.469675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:18.471190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7166fb-87aa-422c-afef-eb5902b7a0a5 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:18.489406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 603/1210] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:20.965918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1427-b119-48f8-8eb0-2c478b4f79e6 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:20.966487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1427-b119-48f8-8eb0-2c478b4f79e6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:20.966487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1427-b119-48f8-8eb0-2c478b4f79e6 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:20.968565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 608/1211] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:20.976063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f386836-0b05-4074-a419-1ee021779d73 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:20.976480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f386836-0b05-4074-a419-1ee021779d73 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:20.976629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f386836-0b05-4074-a419-1ee021779d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:21.039320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2f386836-0b05-4074-a419-1ee021779d73 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:21.040549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2f386836-0b05-4074-a419-1ee021779d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:21.134808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 604/1212] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:21.190630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:21.190911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:21.191187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:21.193006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 609/1213] 10.222.0.79 () {54 vars in 963 bytes} [Fri Jan 28 01:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:21.199929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239335-fad8-44f4-a747-4ac2ad1d11cc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:21.200239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239335-fad8-44f4-a747-4ac2ad1d11cc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:21.200514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239335-fad8-44f4-a747-4ac2ad1d11cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:21.273549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-23239335-fad8-44f4-a747-4ac2ad1d11cc None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:21.274660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-23239335-fad8-44f4-a747-4ac2ad1d11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:21.346579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 605/1214] 10.222.0.79 () {58 vars in 1060 bytes} [Fri Jan 28 01:57:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:21.355873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:21.357436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:21.456464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463b3e-7773-4fc0-b208-86cc65a75d6f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:21.532663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:21.533224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:21.533501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:21.533769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:21.535368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:21.641432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:21.642868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fbed5-6f1f-4e59-a5de-4384fdad3e8d service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:21.660519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 610/1215] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:24.706219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:24.706826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:24.706826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:24.708798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 606/1216] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:24.717461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:24.718219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:24.718315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:24.788096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:24.789322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:24.897760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 611/1217] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:24.933387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:24.934922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:25.064765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dae5b-5876-42c5-8f84-f5697b90485a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.164824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.165627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.166263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.166655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.177635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.179687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2f4b5-9132-4a0c-b1c8-5908dddaa757 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.181429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 607/1218] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:57:24 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:25.194611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:25.195845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:25.286068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97287683-f02b-44eb-8835-48ab3a640fa4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:25.358018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:25.358575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:25.358856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:25.359127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:25.360771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:25.476161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:25.477601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8b700-a840-4e8b-95e1-a0ecb040f14d service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:25.496569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 612/1219] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:28.456754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:28.457414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:28.457414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:28.459178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 608/1220] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:28.468892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:28.469438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:28.469438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:28.536391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:28.537614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:28.648302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 613/1221] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:57:28.686282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:28.687827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:28.819166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b296fe5-7cd1-40b4-bae0-c7bc79290123 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:28.922292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:28.923139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:28.923413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:28.923679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:28.934633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:28.937123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a395b9-f9e8-4b28-b1f7-ebe6dcb2725c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:28.940109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 609/1222] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:57:28 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:28.958784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:28.960021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:29.054540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28865-7c6c-443f-963a-2dd5b3600a67 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:29.134180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:29.134899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:29.135288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:29.135668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:29.137976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:29.272061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:29.273559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dd12-b23f-422d-b68e-7a40c79b37e4 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:29.291467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 614/1223] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:32.482576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.483201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.483201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.484993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 610/1224] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:32.493320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033043b-632b-4669-8e96-06b5c1da1817 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.493816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033043b-632b-4669-8e96-06b5c1da1817 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.493936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033043b-632b-4669-8e96-06b5c1da1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.568423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3033043b-632b-4669-8e96-06b5c1da1817 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:32.569659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3033043b-632b-4669-8e96-06b5c1da1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.675727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 615/1225] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:32.714209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:32.716027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:32.820370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a16f6-7f51-4a6a-ace2-00d569657e6f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:32.898081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:32.898726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:32.899010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:32.899286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:32.900944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:33.011410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:33.012797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b855bb-9769-444c-8532-4f61e75549fe service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:33.030635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 611/1226] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:35.330645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.338401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.338401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.338401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 616/1227] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:35.341549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec7306-1793-4a42-8d60-9eed5cc8943c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.342019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec7306-1793-4a42-8d60-9eed5cc8943c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.342118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec7306-1793-4a42-8d60-9eed5cc8943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.410617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ffec7306-1793-4a42-8d60-9eed5cc8943c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:35.411901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ffec7306-1793-4a42-8d60-9eed5cc8943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.514155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 612/1228] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:35.552601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:35.554197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.662364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387777be-263c-4810-a2b7-b8e90bc80b7f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:35.738468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:35.739116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:35.739400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:35.739675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:35.741376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:35.859115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:35.860609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39bfd2-f9c1-4984-a7f4-70f0f74e8d90 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:35.879504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 617/1229] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:35 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:38.168721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.169567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.169722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.171872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 613/1230] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:38.179871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.180419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.180506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.249142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:38.250361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.356085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 618/1231] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:38.389751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.391832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.531021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f18d4-c876-4721-9431-4ad12f2cc3d5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.630943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.631795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.632148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.632417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.642350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.645248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90da64-4e15-4eb7-98e0-e2f8e63cd0af admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.647317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 614/1232] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:57:38.660483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:38.661690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.753624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe0151-cd8f-471b-8013-c9520e944f80 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:38.828085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:38.828726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:38.829080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:38.829264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:38.830881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:38.958703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:38.958703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976d94f-5237-4f54-b2e1-a332d3597850 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:38.975881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 619/1233] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:41.707081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.707654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.707654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.709506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 615/1234] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:41.717558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a250-2479-4ff3-a687-524a9db2e267 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:41.718292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a250-2479-4ff3-a687-524a9db2e267 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:41.718426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a250-2479-4ff3-a687-524a9db2e267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:41.786005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9be4a250-2479-4ff3-a687-524a9db2e267 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:41.787217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9be4a250-2479-4ff3-a687-524a9db2e267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:41.893483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 620/1235] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:41.930863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:41.932449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.036466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8ba7e-6174-45ed-aead-e5d6d7f473d0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:42.109688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:42.110331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:42.110617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:42.110947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:42.112674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:42.221017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:42.222442 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df067cb-46b0-4717-817e-ba68ae35fc29 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:42.240276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 616/1236] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:44.480091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.480651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.480651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.482402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 621/1237] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:44.490233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281711b2-9c4a-4db8-963b-d61881f6ff12 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.493032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281711b2-9c4a-4db8-963b-d61881f6ff12 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.493032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281711b2-9c4a-4db8-963b-d61881f6ff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.562146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-281711b2-9c4a-4db8-963b-d61881f6ff12 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:44.563346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-281711b2-9c4a-4db8-963b-d61881f6ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.667642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 617/1238] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:44.709127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:44.711425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:44.811741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45ac5-c15d-4fb9-844c-18a9c18610a7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:44.824801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:44.825442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:44.825725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:44.826000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:44.834780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:44.836250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477516e1-4c26-4162-b159-b0440dab0a26 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:44.846502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 622/1239] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:48.052194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90649846-415f-47b3-ab3e-63b81eae9aba None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.052745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90649846-415f-47b3-ab3e-63b81eae9aba None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.052745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90649846-415f-47b3-ab3e-63b81eae9aba None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.054518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 618/1240] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:48.062378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5eda-25f3-408e-b875-1184d3a1a358 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.062846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5eda-25f3-408e-b875-1184d3a1a358 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.062846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5eda-25f3-408e-b875-1184d3a1a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.081541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-784d5eda-25f3-408e-b875-1184d3a1a358 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:48.082736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-784d5eda-25f3-408e-b875-1184d3a1a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:48.091587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 623/1241] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:48.128180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90649846-415f-47b3-ab3e-63b81eae9aba None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:48.149014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90649846-415f-47b3-ab3e-63b81eae9aba None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:48.152788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:48.153453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:48.153731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:48.154000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:48.162960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:48.164410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61a31-9313-4776-ae16-dc33da58edc9 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:48.174527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 619/1242] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:57:52.861178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342312-0921-4582-8557-eff765560b0a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.861627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342312-0921-4582-8557-eff765560b0a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.861743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342312-0921-4582-8557-eff765560b0a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.863553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 624/1243] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:52.872357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47090-cf4e-42b8-8a3b-0ddd950ed4af None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.872875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47090-cf4e-42b8-8a3b-0ddd950ed4af None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.872964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db47090-cf4e-42b8-8a3b-0ddd950ed4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.894673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7db47090-cf4e-42b8-8a3b-0ddd950ed4af None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:52.895883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7db47090-cf4e-42b8-8a3b-0ddd950ed4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:52.904831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 620/1244] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:52.946502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342312-0921-4582-8557-eff765560b0a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:52.966455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342312-0921-4582-8557-eff765560b0a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:52.970962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:52.972212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:52.972212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:52.972212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:52.984806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:52.986262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594975-be80-4099-b5e0-362913fe7257 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:52.997821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 625/1245] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:57:56.383686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0193b-9b72-48ab-ab02-22e05f62b36b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.384379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0193b-9b72-48ab-ab02-22e05f62b36b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.384379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0193b-9b72-48ab-ab02-22e05f62b36b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.386450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 621/1246] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:57:56.394194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad69e27-881c-44b9-9125-c2d3d8ca6cf3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.394668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad69e27-881c-44b9-9125-c2d3d8ca6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.394668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad69e27-881c-44b9-9125-c2d3d8ca6cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.417451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9ad69e27-881c-44b9-9125-c2d3d8ca6cf3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:57:56.418680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9ad69e27-881c-44b9-9125-c2d3d8ca6cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:57:56.428307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 626/1247] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:57:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:57:56.469843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0193b-9b72-48ab-ab02-22e05f62b36b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:57:56.481264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0193b-9b72-48ab-ab02-22e05f62b36b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:57:56.484784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:57:56.485419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:57:56.485702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:57:56.485975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:57:56.495627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:57:56.497131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff3c2e-7707-4f85-a5e3-daf5b84ee931 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:57:56.506517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 622/1248] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:57:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:01.177263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:01.177803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:01.177803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:01.179664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 627/1249] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:01.190084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731833fb-20d9-45d4-afe1-4fd5e6313369 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:01.190776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731833fb-20d9-45d4-afe1-4fd5e6313369 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:01.190776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731833fb-20d9-45d4-afe1-4fd5e6313369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:01.212480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-731833fb-20d9-45d4-afe1-4fd5e6313369 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:01.213756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-731833fb-20d9-45d4-afe1-4fd5e6313369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:01.229357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 623/1250] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:01.267915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:01.270053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:01.283744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a515fa-0416-4921-a7dc-7b7881e92bbe None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:01.287862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:01.288745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:01.289027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:01.289305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:01.300826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:01.302290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231e946-8f3f-4e30-826e-9d05c29cb3d3 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:01.314288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 628/1251] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:07.175705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651947-2f5f-4cb2-8a55-c6f029b2d79c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.177525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651947-2f5f-4cb2-8a55-c6f029b2d79c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.178217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651947-2f5f-4cb2-8a55-c6f029b2d79c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.182261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 624/1252] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 01:58:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:07.187464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2707b-40b8-4b8c-bf25-34eb1b2c972f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:07.188242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2707b-40b8-4b8c-bf25-34eb1b2c972f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:07.188396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2707b-40b8-4b8c-bf25-34eb1b2c972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:07.286038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-46b2707b-40b8-4b8c-bf25-34eb1b2c972f None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:07.287532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-46b2707b-40b8-4b8c-bf25-34eb1b2c972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:07.425774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 629/1253] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 01:58:07 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:12.510295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5a52-f858-4df0-adf3-8a858bc69a6b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.510839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5a52-f858-4df0-adf3-8a858bc69a6b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.511244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5a52-f858-4df0-adf3-8a858bc69a6b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.513419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 625/1254] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 01:58:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:12.519577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f7c0-d589-414a-8601-06b580523534 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:12.520163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f7c0-d589-414a-8601-06b580523534 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:12.520163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f7c0-d589-414a-8601-06b580523534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:12.539311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-7a60f7c0-d589-414a-8601-06b580523534 None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:12.540781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7a60f7c0-d589-414a-8601-06b580523534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:12.549824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 630/1255] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 01:58:12 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:14.697983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d475f-54df-48f4-b073-1b1d1dccaa35 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.698584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d475f-54df-48f4-b073-1b1d1dccaa35 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.698668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d475f-54df-48f4-b073-1b1d1dccaa35 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.702260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 626/1256] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 01:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:14.708667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f227ca-5e61-46b0-8cd3-0c286ad37b77 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:14.709469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f227ca-5e61-46b0-8cd3-0c286ad37b77 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:14.709469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f227ca-5e61-46b0-8cd3-0c286ad37b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:14.732306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b7f227ca-5e61-46b0-8cd3-0c286ad37b77 None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:14.733536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b7f227ca-5e61-46b0-8cd3-0c286ad37b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:14.743562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 631/1257] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 01:58:14 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:18.494154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8530c-0568-420f-a7f2-441b08b0eb42 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.494900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8530c-0568-420f-a7f2-441b08b0eb42 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.494900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8530c-0568-420f-a7f2-441b08b0eb42 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.496525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 627/1258] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:18.505561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68259a-7d07-4459-b43b-e08349c6a252 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.506151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68259a-7d07-4459-b43b-e08349c6a252 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.506539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68259a-7d07-4459-b43b-e08349c6a252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.540453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-fb68259a-7d07-4459-b43b-e08349c6a252 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:18.540453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fb68259a-7d07-4459-b43b-e08349c6a252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:18.550614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 632/1259] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:18.613657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623274-15fc-48ca-9d66-82e4dea7ba22 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.614183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623274-15fc-48ca-9d66-82e4dea7ba22 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.614607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623274-15fc-48ca-9d66-82e4dea7ba22 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.619543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 628/1260] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 01:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:18.626921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd47075-351a-419a-b9f7-1132c12dc813 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.628728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd47075-351a-419a-b9f7-1132c12dc813 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.629019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd47075-351a-419a-b9f7-1132c12dc813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.721480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-1cd47075-351a-419a-b9f7-1132c12dc813 None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:18.723064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1cd47075-351a-419a-b9f7-1132c12dc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:18.861402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 633/1261] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 01:58:18 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:18.873630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9623274-15fc-48ca-9d66-82e4dea7ba22 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:18.891964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9623274-15fc-48ca-9d66-82e4dea7ba22 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:18.904615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:18.906048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:18.906724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:18.907222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:18.919602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:18.922079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07424d9f-2bee-4425-afd1-e2404f61be09 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:18.934343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 629/1262] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:21.910975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dedcb-3d92-406e-b007-80eba2320d83 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.912014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dedcb-3d92-406e-b007-80eba2320d83 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.912014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dedcb-3d92-406e-b007-80eba2320d83 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.917434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 634/1263] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:21.929127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6531c6-dd44-49fb-9b41-febd5a22b554 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:21.930524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6531c6-dd44-49fb-9b41-febd5a22b554 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:21.930749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6531c6-dd44-49fb-9b41-febd5a22b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:21.958348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8c6531c6-dd44-49fb-9b41-febd5a22b554 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:21.960448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8c6531c6-dd44-49fb-9b41-febd5a22b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:21.976155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 630/1264] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:21 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:22.050278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dedcb-3d92-406e-b007-80eba2320d83 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:22.077998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dedcb-3d92-406e-b007-80eba2320d83 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:22.087175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:22.088254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:22.088739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:22.089258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:22.100232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:22.103743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f753-0c95-47f1-9832-bbd8a9a14386 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:22.127335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 635/1265] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:22 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:25.342591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e1f2-1c25-4b20-bcb8-77ab7dbb1c7d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.343481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e1f2-1c25-4b20-bcb8-77ab7dbb1c7d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.343762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516e1f2-1c25-4b20-bcb8-77ab7dbb1c7d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.345589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 631/1266] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:25.357350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3ced-41eb-433a-a0ee-b9bf9b938ba8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.357858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3ced-41eb-433a-a0ee-b9bf9b938ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.358303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3ced-41eb-433a-a0ee-b9bf9b938ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.390565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0afe3ced-41eb-433a-a0ee-b9bf9b938ba8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:25.392222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0afe3ced-41eb-433a-a0ee-b9bf9b938ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:25.402435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 636/1267] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:25.458122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4d216-c345-4427-b4db-d9f3d6c409d8 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.458486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4d216-c345-4427-b4db-d9f3d6c409d8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.458931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4d216-c345-4427-b4db-d9f3d6c409d8 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.460908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 632/1268] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 01:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:25.468395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2263b-c3d4-4b45-9125-811e653a4edd None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.469007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2263b-c3d4-4b45-9125-811e653a4edd None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.469894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2263b-c3d4-4b45-9125-811e653a4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.498642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-02b2263b-c3d4-4b45-9125-811e653a4edd None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:25.499860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-02b2263b-c3d4-4b45-9125-811e653a4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:25.528647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 637/1269] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 01:58:25 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:25.534226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4d216-c345-4427-b4db-d9f3d6c409d8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:25.558716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4d216-c345-4427-b4db-d9f3d6c409d8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:25.567197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:25.567947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:25.568354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:25.569982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:25.579459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:25.581529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbecd1-4135-4355-b462-3585bd860e27 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:25.593393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 633/1270] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:28.196652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b324-13f4-483c-a1b7-8f0aae2e8649 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:28.197394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b324-13f4-483c-a1b7-8f0aae2e8649 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:28.197394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618b324-13f4-483c-a1b7-8f0aae2e8649 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:28.198987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 638/1271] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:28.207045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102b38-94ac-4092-90e5-96bf569fd998 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:28.207955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102b38-94ac-4092-90e5-96bf569fd998 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:28.207955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76102b38-94ac-4092-90e5-96bf569fd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:28.227410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-76102b38-94ac-4092-90e5-96bf569fd998 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:28.228828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-76102b38-94ac-4092-90e5-96bf569fd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:28.238022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 634/1272] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:28.297220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618b324-13f4-483c-a1b7-8f0aae2e8649 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:28.317676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618b324-13f4-483c-a1b7-8f0aae2e8649 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:28.326927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:28.328086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:28.328641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:28.329363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:28.346088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:28.349214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb985f4-f3a1-4e2f-9a74-de798150f965 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:28.372428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 639/1273] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:29.018390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df8ac2-0393-4e9d-86ee-ffd184ef8b06 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:29.019169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df8ac2-0393-4e9d-86ee-ffd184ef8b06 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:29.019860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df8ac2-0393-4e9d-86ee-ffd184ef8b06 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:29.022414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 635/1274] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:29.032252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0538-9d03-4ce3-a7fc-bcd7566ffac6 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:29.032716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0538-9d03-4ce3-a7fc-bcd7566ffac6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:29.033388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab0538-9d03-4ce3-a7fc-bcd7566ffac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:29.065566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b7ab0538-9d03-4ce3-a7fc-bcd7566ffac6 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:29.068314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b7ab0538-9d03-4ce3-a7fc-bcd7566ffac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:29.085606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 640/1275] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:29.159158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e0ee-c9b7-4307-9cb8-c166a1ccd88a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:29.159463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e0ee-c9b7-4307-9cb8-c166a1ccd88a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:29.159851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0e0ee-c9b7-4307-9cb8-c166a1ccd88a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:29.161823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 636/1276] 10.222.0.79 () {54 vars in 962 bytes} [Fri Jan 28 01:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:29.172836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426920fa-f178-42cb-952b-f1068bd7fad5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:29.173378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426920fa-f178-42cb-952b-f1068bd7fad5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:29.175251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426920fa-f178-42cb-952b-f1068bd7fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:29.260682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-426920fa-f178-42cb-952b-f1068bd7fad5 None None] MFA Rules not processed for user `8912268c49fc4532a9b920995b286ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:29.262782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-426920fa-f178-42cb-952b-f1068bd7fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:29.358887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 641/1277] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Jan 28 01:58:29 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:29.372967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0e0ee-c9b7-4307-9cb8-c166a1ccd88a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:29.393035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0e0ee-c9b7-4307-9cb8-c166a1ccd88a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:29.401454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:29.407056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:29.407056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:29.407056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:29.424886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:29.427021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a09b8-2c56-4b95-8437-7dff5fb466ad service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:29.448212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 637/1278] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:31.258429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47120-8ac2-4c0e-860b-74eb57e0dfaf None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:31.259446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47120-8ac2-4c0e-860b-74eb57e0dfaf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:31.259733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47120-8ac2-4c0e-860b-74eb57e0dfaf None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:31.261686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 642/1279] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:31.269788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765c22-6d20-4d44-9145-b371ea34a494 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:31.270319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765c22-6d20-4d44-9145-b371ea34a494 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:31.270319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765c22-6d20-4d44-9145-b371ea34a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:31.290603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ab765c22-6d20-4d44-9145-b371ea34a494 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:31.291820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ab765c22-6d20-4d44-9145-b371ea34a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:31.300716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 638/1280] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:31.351405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47120-8ac2-4c0e-860b-74eb57e0dfaf None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:31.371146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47120-8ac2-4c0e-860b-74eb57e0dfaf None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:31.376940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:31.377596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:31.377876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:31.378150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:31.390739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:31.392383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64007d8-6da4-4d8f-af61-ed6142766227 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:31.406911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 643/1281] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:34.050177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574e4a-af12-42be-9ea7-cfb7bc139160 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.050796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574e4a-af12-42be-9ea7-cfb7bc139160 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.050796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574e4a-af12-42be-9ea7-cfb7bc139160 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.052930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 639/1282] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:34.061934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cc370-c01f-4865-8dfc-09fdecae3559 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.062480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cc370-c01f-4865-8dfc-09fdecae3559 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.062480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cc370-c01f-4865-8dfc-09fdecae3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.082465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-aa8cc370-c01f-4865-8dfc-09fdecae3559 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:34.083710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-aa8cc370-c01f-4865-8dfc-09fdecae3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:34.096355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 644/1283] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:34.148008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574e4a-af12-42be-9ea7-cfb7bc139160 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:34.164522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574e4a-af12-42be-9ea7-cfb7bc139160 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:34.170407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:34.171275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:34.171793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:34.172370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:34.182068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:34.184017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafeda6-a8c6-4df9-9f44-995339c88b01 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:34.194493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 640/1284] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:36.718833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d579c-cbc2-4054-b138-a7cbe4ad4d84 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.719373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d579c-cbc2-4054-b138-a7cbe4ad4d84 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.719373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d579c-cbc2-4054-b138-a7cbe4ad4d84 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.721168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 645/1285] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:36.729776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773e1-dd64-43f8-8548-7c2ce1f38d48 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.730264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773e1-dd64-43f8-8548-7c2ce1f38d48 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.730354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61773e1-dd64-43f8-8548-7c2ce1f38d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.748530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d61773e1-dd64-43f8-8548-7c2ce1f38d48 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:36.749707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d61773e1-dd64-43f8-8548-7c2ce1f38d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:36.758297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 641/1286] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:36.806819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d579c-cbc2-4054-b138-a7cbe4ad4d84 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:36.821888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d579c-cbc2-4054-b138-a7cbe4ad4d84 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:36.827662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:36.828333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:36.828616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:36.828889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:36.839216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:36.840833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a40b4e-055b-4d23-9000-97ff18823238 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:36.851053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 646/1287] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:39.398776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c07c0-b7c4-4a57-a555-733eab1f9d90 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:39.398776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c07c0-b7c4-4a57-a555-733eab1f9d90 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:39.399776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c07c0-b7c4-4a57-a555-733eab1f9d90 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:39.400873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 642/1288] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:39.409696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514edcfa-3e4a-4caf-9674-44f3a4fea075 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:39.410535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514edcfa-3e4a-4caf-9674-44f3a4fea075 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:39.410700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514edcfa-3e4a-4caf-9674-44f3a4fea075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:39.434270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-514edcfa-3e4a-4caf-9674-44f3a4fea075 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:39.436006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-514edcfa-3e4a-4caf-9674-44f3a4fea075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:39.450555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 647/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:39.500681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c07c0-b7c4-4a57-a555-733eab1f9d90 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:39.519415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c07c0-b7c4-4a57-a555-733eab1f9d90 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:39.526184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:39.526838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:39.527121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:39.527400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:39.539870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:39.542073 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95635c0b-2c77-441a-b506-180a2dd0abb6 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:39.555808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 643/1290] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:42.169452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab089b4-23cc-456e-a84d-dae97201b1e2 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:42.170004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab089b4-23cc-456e-a84d-dae97201b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:42.170100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab089b4-23cc-456e-a84d-dae97201b1e2 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:42.171852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 648/1291] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:42.180642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdba9a-ed0b-4d96-bb94-1bd24b30bb88 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:42.181777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdba9a-ed0b-4d96-bb94-1bd24b30bb88 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:42.181777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdba9a-ed0b-4d96-bb94-1bd24b30bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:42.203290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d5bdba9a-ed0b-4d96-bb94-1bd24b30bb88 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:42.204535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d5bdba9a-ed0b-4d96-bb94-1bd24b30bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:42.213176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 644/1292] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:42.262638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab089b4-23cc-456e-a84d-dae97201b1e2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:42.279072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab089b4-23cc-456e-a84d-dae97201b1e2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:42.284986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:42.285636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:42.285946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:42.286224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:42.295602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:42.297263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2847a49-184c-4037-a872-4af64823cbaf service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:42.308655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 649/1293] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:42 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:44.798686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819c57-a9c1-438e-bf48-16c18fd40de5 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:44.799256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819c57-a9c1-438e-bf48-16c18fd40de5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:44.799256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819c57-a9c1-438e-bf48-16c18fd40de5 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:44.801099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 645/1294] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:44.810688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261e54-5131-44f5-a129-b10047025c78 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:44.811233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261e54-5131-44f5-a129-b10047025c78 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:44.811233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261e54-5131-44f5-a129-b10047025c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:44.830970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-1a261e54-5131-44f5-a129-b10047025c78 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:44.832297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1a261e54-5131-44f5-a129-b10047025c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:44.840854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 650/1295] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:44 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:44.892275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79819c57-a9c1-438e-bf48-16c18fd40de5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:44.907451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79819c57-a9c1-438e-bf48-16c18fd40de5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:44.914368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:44.915043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:44.915444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:44.915729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:44.930517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:44.932171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c082e8-1dbc-4d53-97ac-141998f29b5f service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:44.947354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 646/1296] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:45.848125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08caa1-7201-4b7e-8137-5c237d749222 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:45.848125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08caa1-7201-4b7e-8137-5c237d749222 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:45.848125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08caa1-7201-4b7e-8137-5c237d749222 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:45.848125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 651/1297] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:45.854838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1e0e-995f-4edc-b2e7-f9be430c5229 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:45.855323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1e0e-995f-4edc-b2e7-f9be430c5229 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:45.855413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf1e0e-995f-4edc-b2e7-f9be430c5229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:45.875731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-41bf1e0e-995f-4edc-b2e7-f9be430c5229 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:45.876993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-41bf1e0e-995f-4edc-b2e7-f9be430c5229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:45.890173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 647/1298] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:45.949361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13bfd-8b9c-48e7-900d-1c475127caf5 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:45.949752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13bfd-8b9c-48e7-900d-1c475127caf5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:45.950097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13bfd-8b9c-48e7-900d-1c475127caf5 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:45.952214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 652/1299] 10.222.0.79 () {54 vars in 961 bytes} [Fri Jan 28 01:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:45.957593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13eda4-67d4-4cf7-85b8-98d02e65acee None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:45.958005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13eda4-67d4-4cf7-85b8-98d02e65acee None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:45.958286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13eda4-67d4-4cf7-85b8-98d02e65acee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.019255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2c13eda4-67d4-4cf7-85b8-98d02e65acee None None] MFA Rules not processed for user `d6a1d87117d143488e1701ac0407ff28`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:46.020564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2c13eda4-67d4-4cf7-85b8-98d02e65acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.093018 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 648/1300] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Jan 28 01:58:45 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:46.103150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13bfd-8b9c-48e7-900d-1c475127caf5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:46.118514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13bfd-8b9c-48e7-900d-1c475127caf5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:46.124935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:46.126019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.126544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.127028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.145859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:46.148687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab9ba-be4b-4f10-8266-16d6fcfb0003 service glance] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:46.160726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 653/1301] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:58:46.839129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17acc-caf0-4016-8e6a-0fd57dd44330 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:46.847337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17acc-caf0-4016-8e6a-0fd57dd44330 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:46.847337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17acc-caf0-4016-8e6a-0fd57dd44330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:46.901672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-36c17acc-caf0-4016-8e6a-0fd57dd44330 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:46.902898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36c17acc-caf0-4016-8e6a-0fd57dd44330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:46.978819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 649/1302] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 01:58:46 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:47.025136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411b52-ba8b-4975-b7b2-3e65d11188d1 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.025909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411b52-ba8b-4975-b7b2-3e65d11188d1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.026089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88411b52-ba8b-4975-b7b2-3e65d11188d1 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.028008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 654/1303] 10.222.0.79 () {54 vars in 942 bytes} [Fri Jan 28 01:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:47.035031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394eff6-2507-47f1-b4eb-87bcb215a7c6 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.035318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394eff6-2507-47f1-b4eb-87bcb215a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.035597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394eff6-2507-47f1-b4eb-87bcb215a7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.090656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4394eff6-2507-47f1-b4eb-87bcb215a7c6 None None] MFA Rules not processed for user `7a31cb414c8c418b96621a93ba3fff06`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.091903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4394eff6-2507-47f1-b4eb-87bcb215a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.192031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 650/1304] 10.222.0.79 () {58 vars in 1039 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3447 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.203008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88411b52-ba8b-4975-b7b2-3e65d11188d1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.217629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88411b52-ba8b-4975-b7b2-3e65d11188d1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.223073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.223728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.224051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.224327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.234632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.236613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250f877-ae12-477c-a439-b7eebcb2fc35 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.247379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 655/1305] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:58:47.512919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6dbbe-ea41-4607-a3e4-b2011932f816 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.513105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6dbbe-ea41-4607-a3e4-b2011932f816 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.513387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6dbbe-ea41-4607-a3e4-b2011932f816 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.515179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 651/1306] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:58:47.528522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143da50-b013-40db-bdf5-af99dc8953d1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.528811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143da50-b013-40db-bdf5-af99dc8953d1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.529092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143da50-b013-40db-bdf5-af99dc8953d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.548430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b143da50-b013-40db-bdf5-af99dc8953d1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:47.549647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b143da50-b013-40db-bdf5-af99dc8953d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:47.559006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 656/1307] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:58:47.611478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6dbbe-ea41-4607-a3e4-b2011932f816 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:47.629141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6dbbe-ea41-4607-a3e4-b2011932f816 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:47.641654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:47.642393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:47.642671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:47.642945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:47.653555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:47.655538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42fd8c-03a3-4732-9c65-d2470a17f137 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:47.667333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 652/1308] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:58:50.740487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b75f-9575-4e60-b95a-56d2ff567606 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.742195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b75f-9575-4e60-b95a-56d2ff567606 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.742195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b75f-9575-4e60-b95a-56d2ff567606 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.744390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 657/1309] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:58:50.757672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855387c-7807-4e86-891a-39ad508bc60e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.758762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855387c-7807-4e86-891a-39ad508bc60e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.758762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855387c-7807-4e86-891a-39ad508bc60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.778830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a855387c-7807-4e86-891a-39ad508bc60e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:58:50.780787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a855387c-7807-4e86-891a-39ad508bc60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:58:50.790667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 653/1310] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:58:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:58:50.839437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b75f-9575-4e60-b95a-56d2ff567606 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:58:50.863644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b75f-9575-4e60-b95a-56d2ff567606 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:58:50.872437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:58:50.873475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:58:50.873921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:58:50.874367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:58:50.886025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:58:50.886679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f13b5-4382-4f29-861f-d09ca12c7136 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:58:50.900896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 658/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:58:50 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:07.469285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aff52-94d0-4b22-9ba8-f5cb0b627987 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.469896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aff52-94d0-4b22-9ba8-f5cb0b627987 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.469896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aff52-94d0-4b22-9ba8-f5cb0b627987 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.471726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 654/1312] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:07.480466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135443-232a-4433-acdc-a36a4680d522 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.481020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135443-232a-4433-acdc-a36a4680d522 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.481020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6135443-232a-4433-acdc-a36a4680d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.499747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d6135443-232a-4433-acdc-a36a4680d522 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:07.501068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d6135443-232a-4433-acdc-a36a4680d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:07.510079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 659/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:07.534728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aff52-94d0-4b22-9ba8-f5cb0b627987 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:07.547587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aff52-94d0-4b22-9ba8-f5cb0b627987 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:07.553326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:07.553972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:07.554253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:07.554524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:07.555254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:07.557374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1896b3-dfb6-459a-a7c9-24b10a85cbf1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:07.577764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 655/1314] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 01:59:07 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:09.859387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b774f1-9f2e-4272-8f79-065fd0a57c57 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:09.859962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b774f1-9f2e-4272-8f79-065fd0a57c57 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:09.859962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b774f1-9f2e-4272-8f79-065fd0a57c57 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:09.861859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 660/1315] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:09.870870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:09.871638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:09.871746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:09.892915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:09.894129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:09.903170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 656/1316] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:09.928888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b774f1-9f2e-4272-8f79-065fd0a57c57 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:09.941583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b774f1-9f2e-4272-8f79-065fd0a57c57 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:09.946747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:09.947600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:09.947883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:09.948182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] PATH_INFO: `/v3/projects/18019db455ea42be8fb36a25e64c1971` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:09.962572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] RBAC: Authorizing `identity:get_project(project_id=18019db455ea42be8fb36a25e64c1971)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:09.965102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:09.967229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 661/1317] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:09 2022] GET /identity/v3/projects/18019db455ea42be8fb36a25e64c1971 => generated 361 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:09.975296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:09.984456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924f865-211c-4b68-92fc-fd559b109db8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:09.989349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:09.990158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:09.990439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:09.990713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:09.991526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] RBAC: Adding query filter params (scope.project.id=18019db455ea42be8fb36a25e64c1971) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:09.991829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:09.993709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f7094-f09e-4c79-89b7-f2d8d5ce265f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:10.000593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 657/1318] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:09 2022] GET /identity/v3/role_assignments?scope.project.id=18019db455ea42be8fb36a25e64c1971 => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:10.010471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:10.022122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095357d6-38ec-4f3e-860c-38a1d22e42dd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:10.027594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:10.028489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:10.028778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:10.029204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] PATH_INFO: `/v3/users/8ae7314ee7bc43fab15d1869595c43f0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:10.044138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ae7314ee7bc43fab15d1869595c43f0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:10.046308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6195ac-8de5-4ce0-979a-f4a7f31dec82 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:10.048072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 662/1319] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:10 2022] GET /identity/v3/users/8ae7314ee7bc43fab15d1869595c43f0 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:12.469355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bbaff-6b8a-428e-9f82-fd106953abf8 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.469929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bbaff-6b8a-428e-9f82-fd106953abf8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.469929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bbaff-6b8a-428e-9f82-fd106953abf8 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.471671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 658/1320] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:12.481082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807cac-2511-4dae-883a-aead162394b9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.481740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807cac-2511-4dae-883a-aead162394b9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.481740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93807cac-2511-4dae-883a-aead162394b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.501741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-93807cac-2511-4dae-883a-aead162394b9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:12.503060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-93807cac-2511-4dae-883a-aead162394b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:12.511817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 663/1321] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:12.536364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bbaff-6b8a-428e-9f82-fd106953abf8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:12.552801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bbaff-6b8a-428e-9f82-fd106953abf8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:12.557808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:12.558667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.558961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.559248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] PATH_INFO: `/v3/projects/33926690fbc24a2d8d30cdff9ed944f5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.578807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=33926690fbc24a2d8d30cdff9ed944f5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:12.580951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:12.582805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 659/1322] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:12 2022] GET /identity/v3/projects/33926690fbc24a2d8d30cdff9ed944f5 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:12.590616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93807cac-2511-4dae-883a-aead162394b9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:12.607637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93807cac-2511-4dae-883a-aead162394b9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:12.613228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:12.613892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.614170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.614459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.615278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] RBAC: Adding query filter params (scope.project.id=33926690fbc24a2d8d30cdff9ed944f5) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:12.615584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:12.617533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:12.626697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 664/1323] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:12 2022] GET /identity/v3/role_assignments?scope.project.id=33926690fbc24a2d8d30cdff9ed944f5 => generated 1934 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:59:12.634365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:12.646542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4687d-6ae4-4230-81d0-745c60dbdfe0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:12.652432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:12.653718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.654196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.654627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.681204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:12.683377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11c487-7336-4ec7-a780-a6f2082f8546 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:12.685134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 660/1324] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:12 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:12.692884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:12.705635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28920-e331-431f-88e5-bba7ae3af4a9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:12.711438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:12.712499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:12.712780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:12.713074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:12.714263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:12.716087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0498f-97e9-4e40-8a5b-64a4f6d442ae admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:12.717975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 665/1325] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:12 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:15.206395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69810-2d1b-4c4f-98ea-d960ce3d2b43 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.206966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69810-2d1b-4c4f-98ea-d960ce3d2b43 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.207063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d69810-2d1b-4c4f-98ea-d960ce3d2b43 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.210214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 661/1326] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:15.218407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.218896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.218997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.238522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:15.240307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:15.251611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 666/1327] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:15.277698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d69810-2d1b-4c4f-98ea-d960ce3d2b43 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:15.292049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d69810-2d1b-4c4f-98ea-d960ce3d2b43 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:15.297055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:15.298012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.298293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.298631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] PATH_INFO: `/v3/projects/81bf56c01e914cdfa1a63a03503dde77` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.311192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] RBAC: Authorizing `identity:get_project(project_id=81bf56c01e914cdfa1a63a03503dde77)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:15.313298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:15.315075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 662/1328] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:15 2022] GET /identity/v3/projects/81bf56c01e914cdfa1a63a03503dde77 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:59:15.322407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:15.331843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ca2e3-f3bf-43b4-a61c-ea6b7f94a144 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:15.337051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:15.337702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.337980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.338252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.339007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] RBAC: Adding query filter params (scope.project.id=81bf56c01e914cdfa1a63a03503dde77) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:15.339311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:15.341187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:15.350692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 667/1329] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:15 2022] GET /identity/v3/role_assignments?scope.project.id=81bf56c01e914cdfa1a63a03503dde77 => generated 877 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:15.357493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:15.368556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6abb0-03d5-4003-b76c-bab16b1f868e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:15.373245 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:15.374133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.374412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.374686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] PATH_INFO: `/v3/users/5727cf446229439c95f2c9b33a2f030c` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.388886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] RBAC: Authorizing `identity:get_user(user_id=5727cf446229439c95f2c9b33a2f030c)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:15.391045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f754ac-696a-4a2a-8c30-0370f191a624 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:15.392785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 663/1330] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:15 2022] GET /identity/v3/users/5727cf446229439c95f2c9b33a2f030c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:15.399909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:15.409892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ec1f-120e-4936-8983-15f4a2298e7f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:15.415322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:15.416204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:15.416493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:15.416768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] PATH_INFO: `/v3/users/7dc75a2f9d104bc093266b790a6839a5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:15.431705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] RBAC: Authorizing `identity:get_user(user_id=7dc75a2f9d104bc093266b790a6839a5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:15.433898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bceb7da-f544-4d2f-b71b-a1347ba50ec7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:15.435588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 668/1331] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:15 2022] GET /identity/v3/users/7dc75a2f9d104bc093266b790a6839a5 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:17.802236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052e31-9f23-4574-90b6-6c8a9e36093a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:17.803051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052e31-9f23-4574-90b6-6c8a9e36093a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:17.803051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052e31-9f23-4574-90b6-6c8a9e36093a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:17.804643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 664/1332] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:17.812724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:17.813486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:17.813486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:17.831725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:17.833852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:17.842717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 669/1333] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:17.866689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052e31-9f23-4574-90b6-6c8a9e36093a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:17.881527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052e31-9f23-4574-90b6-6c8a9e36093a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:17.887526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:17.888439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:17.888720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:17.888998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] PATH_INFO: `/v3/projects/9ed384f6c4594ad68721f19ac9473b0e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:17.890209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ed384f6c4594ad68721f19ac9473b0e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:17.892041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:17.893765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 665/1334] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:17 2022] GET /identity/v3/projects/9ed384f6c4594ad68721f19ac9473b0e => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:17.904585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:17.914004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f762bd-7270-47c3-8a0a-337363b2e0f2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:17.919031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:17.919213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:17.919486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:17.919758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:17.920558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] RBAC: Adding query filter params (scope.project.id=9ed384f6c4594ad68721f19ac9473b0e) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:17.920862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:17.922694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989f933-5bcb-4426-8935-d2cf1da2e5be admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:17.929687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 670/1335] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:17 2022] GET /identity/v3/role_assignments?scope.project.id=9ed384f6c4594ad68721f19ac9473b0e => generated 879 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:17.936374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:17.947340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69506da4-7281-4573-8f1d-d2d53bd77690 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:17.952859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:17.953715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:17.953984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:17.954261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:17.955646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:17.957500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406eab5-3bad-4905-b835-dafb02c1d41b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:17.959474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 666/1336] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:17 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:20.284421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3ff7-3bd6-4d97-be9a-e2164adf3170 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:20.284982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3ff7-3bd6-4d97-be9a-e2164adf3170 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:20.284982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3ff7-3bd6-4d97-be9a-e2164adf3170 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:20.287480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 671/1337] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:20.295532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:20.296072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:20.296181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:20.315324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:20.316633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:20.326003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 667/1338] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:20.367358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3ff7-3bd6-4d97-be9a-e2164adf3170 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:20.381396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e3ff7-3bd6-4d97-be9a-e2164adf3170 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:20.386831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:20.387691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:20.387998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:20.388277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] PATH_INFO: `/v3/projects/b5eebd726c6241a6be950750719ad294` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:20.411955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5eebd726c6241a6be950750719ad294)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:20.411955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:20.411955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 672/1339] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:20 2022] GET /identity/v3/projects/b5eebd726c6241a6be950750719ad294 => generated 311 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:59:20.416158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:20.425618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07a819-14b0-4621-b4e3-32e99a57f002 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:20.430464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:20.431233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:20.431530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:20.431883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:20.432807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] RBAC: Adding query filter params (scope.project.id=b5eebd726c6241a6be950750719ad294) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:20.433189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:20.435154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfa445-36a0-4e4b-ab22-b8f867c1fc16 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:20.443142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 668/1340] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:20 2022] GET /identity/v3/role_assignments?scope.project.id=b5eebd726c6241a6be950750719ad294 => generated 526 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:20.450442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:20.469250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f494b1-548f-4000-8525-821cfb4197a8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:20.478046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:20.479561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:20.480154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:20.480642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] PATH_INFO: `/v3/users/259eca2ace3f486387f828f1e6be5403` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:20.505744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] RBAC: Authorizing `identity:get_user(user_id=259eca2ace3f486387f828f1e6be5403)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:20.510052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91759f9a-098f-4e5f-bed4-9bfcc746b206 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:20.528003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 673/1341] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:20 2022] GET /identity/v3/users/259eca2ace3f486387f828f1e6be5403 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:22.849920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f98-e075-45c8-825e-ab6efde3f7f0 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:22.850628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f98-e075-45c8-825e-ab6efde3f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:22.850628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6f98-e075-45c8-825e-ab6efde3f7f0 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:22.852409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 669/1342] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:22.860944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:22.861457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:22.861571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:22.878867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:22.880727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:22.888768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 674/1343] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:22.913943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6f98-e075-45c8-825e-ab6efde3f7f0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:22.926743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6f98-e075-45c8-825e-ab6efde3f7f0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:22.931450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:22.932332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:22.932607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:22.932884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] PATH_INFO: `/v3/projects/df95a8b4ec584d53a62e35e19faf8f00` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:22.944742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] RBAC: Authorizing `identity:get_project(project_id=df95a8b4ec584d53a62e35e19faf8f00)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:22.946827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:22.948858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 670/1344] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:22 2022] GET /identity/v3/projects/df95a8b4ec584d53a62e35e19faf8f00 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:22.955592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:22.965733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a2c0-29a9-4ba5-beda-3efd68693f47 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:22.970587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:22.971228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:22.971510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:22.971782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:22.972585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] RBAC: Adding query filter params (scope.project.id=df95a8b4ec584d53a62e35e19faf8f00) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:22.972890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:22.974871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d77efb-b9c1-4865-a36b-40a9d53be019 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:22.980484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 675/1345] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:22 2022] GET /identity/v3/role_assignments?scope.project.id=df95a8b4ec584d53a62e35e19faf8f00 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:22.987512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:22.999002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dd945-ffa3-46ce-a594-50a227f15ea3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:23.004134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:23.005553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:23.005807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:23.006355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] PATH_INFO: `/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:23.007626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] RBAC: Authorizing `identity:get_user(user_id=b29bca7ca3e643e9ac1fc62f9fefa20b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:23.009798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86e15a-4546-4d14-91e8-2814c555560d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:23.012740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 671/1346] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:22 2022] GET /identity/v3/users/b29bca7ca3e643e9ac1fc62f9fefa20b => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:25.295664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e4d1-13f3-4766-b3f6-4f7da7240d0c None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.296257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e4d1-13f3-4766-b3f6-4f7da7240d0c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.296257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e4d1-13f3-4766-b3f6-4f7da7240d0c None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.298017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 676/1347] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 01:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:25.306681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.307265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.307265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.326004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:25.327189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:25.335495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 672/1348] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 01:59:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:25.361167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e4d1-13f3-4766-b3f6-4f7da7240d0c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:25.375340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e4d1-13f3-4766-b3f6-4f7da7240d0c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:25.380403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:25.381304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.381591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.381896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] PATH_INFO: `/v3/projects/ef05a605ed274fbe91300e06be587962` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.394169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] RBAC: Authorizing `identity:get_project(project_id=ef05a605ed274fbe91300e06be587962)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:25.396359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:25.398187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 677/1349] 10.222.0.79 () {56 vars in 1207 bytes} [Fri Jan 28 01:59:25 2022] GET /identity/v3/projects/ef05a605ed274fbe91300e06be587962 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:25.405210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:25.417168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4fd38-01fa-4fc5-ac72-730d4967d8ea None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:25.421912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:25.422557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.422849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.423125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.423898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] RBAC: Adding query filter params (scope.project.id=ef05a605ed274fbe91300e06be587962) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:59:25.424251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:25.426113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:25.434042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 673/1350] 10.222.0.79 () {56 vars in 1231 bytes} [Fri Jan 28 01:59:25 2022] GET /identity/v3/role_assignments?scope.project.id=ef05a605ed274fbe91300e06be587962 => generated 1934 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:59:25.440989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:25.451035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb74a4d-baeb-49fe-bf67-a4eb5b23ba1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:25.456036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:25.457153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.457468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.458434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] PATH_INFO: `/v3/users/93a09500e0284402aff7326e595b798b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.472585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=93a09500e0284402aff7326e595b798b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:25.475329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc29b9-088a-4bdb-bb80-f1990e5476c5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:25.477104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 678/1351] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:25 2022] GET /identity/v3/users/93a09500e0284402aff7326e595b798b => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:59:25.483626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:25.494213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68eaf6-3cc6-4448-970e-d880f111799a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:25.499279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:25.500168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:25.500456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:25.500735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] PATH_INFO: `/v3/users/3562fb362d174fe499304c112522dca6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:25.502134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] RBAC: Authorizing `identity:get_user(user_id=3562fb362d174fe499304c112522dca6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:25.503928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fda823-8199-4076-a82f-c4329dc48b37 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:25.506127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 674/1352] 10.222.0.79 () {56 vars in 1198 bytes} [Fri Jan 28 01:59:25 2022] GET /identity/v3/users/3562fb362d174fe499304c112522dca6 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:59:31.552930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00ed1-ae7d-4c76-ab23-826cfa12fddc None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:31.553530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00ed1-ae7d-4c76-ab23-826cfa12fddc None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:31.553656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00ed1-ae7d-4c76-ab23-826cfa12fddc None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:31.556516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 679/1353] 10.222.0.79 () {54 vars in 918 bytes} [Fri Jan 28 01:59:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:31.673090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0634-01bf-40e5-81e1-d3f76efb7c6a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:31.673921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0634-01bf-40e5-81e1-d3f76efb7c6a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:31.674206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d0634-01bf-40e5-81e1-d3f76efb7c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:31.694190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bc6d0634-01bf-40e5-81e1-d3f76efb7c6a None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:31.695534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bc6d0634-01bf-40e5-81e1-d3f76efb7c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:31.704626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 675/1354] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Jan 28 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:31.722201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c0ed-3d20-412a-a306-5c4f10ab265d None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:31.722642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c0ed-3d20-412a-a306-5c4f10ab265d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:31.723641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9c0ed-3d20-412a-a306-5c4f10ab265d None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:31.726401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 680/1355] 10.222.0.79 () {54 vars in 918 bytes} [Fri Jan 28 01:59:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:31.732408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8c47-bbdd-4957-b14d-250265b99e7d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:31.732874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8c47-bbdd-4957-b14d-250265b99e7d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:31.733200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8c47-bbdd-4957-b14d-250265b99e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:31.752137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-040a8c47-bbdd-4957-b14d-250265b99e7d None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:31.753388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-040a8c47-bbdd-4957-b14d-250265b99e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:31.763447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 676/1356] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Jan 28 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:34.671750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942f10-eee8-4115-913d-62850e5a5f4f None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:34.672369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942f10-eee8-4115-913d-62850e5a5f4f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:34.672718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942f10-eee8-4115-913d-62850e5a5f4f None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:34.675965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 681/1357] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:34.684206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705c0d-9d5d-490b-9d0e-896a1aee551c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:34.684911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705c0d-9d5d-490b-9d0e-896a1aee551c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:34.684911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705c0d-9d5d-490b-9d0e-896a1aee551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:34.703688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-23705c0d-9d5d-490b-9d0e-896a1aee551c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:34.704954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-23705c0d-9d5d-490b-9d0e-896a1aee551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:34.714317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 677/1358] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:34.767930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942f10-eee8-4115-913d-62850e5a5f4f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:34.786796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942f10-eee8-4115-913d-62850e5a5f4f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:34.792928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:34.793586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:34.793876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:34.794163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:34.803590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:34.805269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54d57-fde4-490f-876f-9bd7a409c53a service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:34.819280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 682/1359] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:36.340258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098918a-b9d6-46d1-8833-f1d4eab8a1fb None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:36.340837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098918a-b9d6-46d1-8833-f1d4eab8a1fb None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:36.340837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098918a-b9d6-46d1-8833-f1d4eab8a1fb None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:36.342894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 678/1360] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:36.349949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f317-7a17-44e4-bf29-f78264bfd891 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:36.350588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f317-7a17-44e4-bf29-f78264bfd891 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:36.350588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f317-7a17-44e4-bf29-f78264bfd891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:36.374582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a5e7f317-7a17-44e4-bf29-f78264bfd891 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:36.375797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a5e7f317-7a17-44e4-bf29-f78264bfd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:36.384585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 683/1361] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:36.540316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098918a-b9d6-46d1-8833-f1d4eab8a1fb None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:36.560091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098918a-b9d6-46d1-8833-f1d4eab8a1fb None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:36.568827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:36.569956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:36.570438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:36.570938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:36.585384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:36.587002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89977-6ad6-4255-9fc0-cb586bd59a84 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:36.597422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 679/1362] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:38.061075 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef24f5-50a8-4ab8-85a5-d80edcd88b49 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.061638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef24f5-50a8-4ab8-85a5-d80edcd88b49 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.061638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef24f5-50a8-4ab8-85a5-d80edcd88b49 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.065178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 684/1363] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:38.071939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716fd7c-f755-4a2a-adaf-a5fdb0c5aa53 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.072512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716fd7c-f755-4a2a-adaf-a5fdb0c5aa53 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.072512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716fd7c-f755-4a2a-adaf-a5fdb0c5aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.100819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2716fd7c-f755-4a2a-adaf-a5fdb0c5aa53 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:38.102028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2716fd7c-f755-4a2a-adaf-a5fdb0c5aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:38.109903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 680/1364] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:38.277641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef24f5-50a8-4ab8-85a5-d80edcd88b49 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:38.293473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef24f5-50a8-4ab8-85a5-d80edcd88b49 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:38.299048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:38.299685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:38.299983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:38.300336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:38.309172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:38.310759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b0ea-2165-42ba-97c7-a61944fc01ab service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:38.321338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 685/1365] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:39.777725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daccb2-514a-4767-b4ff-f36d77004b58 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.778345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daccb2-514a-4767-b4ff-f36d77004b58 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.778345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daccb2-514a-4767-b4ff-f36d77004b58 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.780093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 681/1366] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:39.786215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72b01-5816-4a12-b6d2-529b77c58166 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:39.786830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72b01-5816-4a12-b6d2-529b77c58166 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:39.786830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72b01-5816-4a12-b6d2-529b77c58166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:39.812214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2fb72b01-5816-4a12-b6d2-529b77c58166 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:39.813512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2fb72b01-5816-4a12-b6d2-529b77c58166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:39.821712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 686/1367] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:39.981446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daccb2-514a-4767-b4ff-f36d77004b58 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:39.996024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daccb2-514a-4767-b4ff-f36d77004b58 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:40.001759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:40.002393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:40.002669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:40.002944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:40.011687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:40.013315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe24a8-8830-4235-b8f6-ed88f0ecdbb3 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:40.024355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 682/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:39 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:41.532725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f60b6-9b9f-4aad-9f37-22accdb25b0b None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:41.533346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f60b6-9b9f-4aad-9f37-22accdb25b0b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:41.533346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f60b6-9b9f-4aad-9f37-22accdb25b0b None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:41.535721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 687/1369] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:41.542253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2269-be00-4488-b956-7ea85e8142a0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:41.542761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2269-be00-4488-b956-7ea85e8142a0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:41.542892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2269-be00-4488-b956-7ea85e8142a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:41.560929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4c3b2269-be00-4488-b956-7ea85e8142a0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:41.562302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4c3b2269-be00-4488-b956-7ea85e8142a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:41.571923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 683/1370] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:41.732871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f60b6-9b9f-4aad-9f37-22accdb25b0b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:41.748169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f60b6-9b9f-4aad-9f37-22accdb25b0b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:41.754524 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:41.755165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:41.755488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:41.755764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:41.764926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:41.766517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047f5c1-2f87-4dbb-acb0-7b21c48f3868 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:41.778061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 688/1371] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:43.409230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99538-20c9-4f68-a028-bf540d49fa4c None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.409834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99538-20c9-4f68-a028-bf540d49fa4c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.410031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99538-20c9-4f68-a028-bf540d49fa4c None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.411879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 684/1372] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:43.417788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362953-0bba-4d6a-ad34-977540c4c429 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.418223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362953-0bba-4d6a-ad34-977540c4c429 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.418339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da362953-0bba-4d6a-ad34-977540c4c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.437821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-da362953-0bba-4d6a-ad34-977540c4c429 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:43.439009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-da362953-0bba-4d6a-ad34-977540c4c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:43.447034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 689/1373] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:43.608713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99538-20c9-4f68-a028-bf540d49fa4c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:43.623693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99538-20c9-4f68-a028-bf540d49fa4c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:43.630788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:43.631468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:43.631748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:43.632058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:43.641249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:43.643049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd3372-2bf1-4fcf-94d5-82f2689031a0 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:43.653574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 685/1374] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:43 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:45.137049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570397-05ad-4769-91f8-e4bf9cf4ef3d None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.137617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570397-05ad-4769-91f8-e4bf9cf4ef3d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.137617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570397-05ad-4769-91f8-e4bf9cf4ef3d None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.139511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 690/1375] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:45.146178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a425d3-cbde-4256-92ab-582ee37b4b3a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.146584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a425d3-cbde-4256-92ab-582ee37b4b3a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.146722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a425d3-cbde-4256-92ab-582ee37b4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.165828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d1a425d3-cbde-4256-92ab-582ee37b4b3a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:45.167039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d1a425d3-cbde-4256-92ab-582ee37b4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:45.174926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 686/1376] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:45 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:45.339080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570397-05ad-4769-91f8-e4bf9cf4ef3d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:45.354056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570397-05ad-4769-91f8-e4bf9cf4ef3d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:45.359738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:45.360422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:45.360707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:45.360994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:45.370380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:45.371960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858c18-303b-4164-97ed-e6fc91a30baa service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:45.382133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 691/1377] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:45 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:46.828929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506534c-f46e-4cb1-a234-a85ad6ee7755 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:46.829467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506534c-f46e-4cb1-a234-a85ad6ee7755 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:46.829467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506534c-f46e-4cb1-a234-a85ad6ee7755 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:46.831260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 687/1378] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:46.838897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c88fd-9ff9-42dd-8d20-15bfa19a1a87 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:46.839376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c88fd-9ff9-42dd-8d20-15bfa19a1a87 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:46.839472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c88fd-9ff9-42dd-8d20-15bfa19a1a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:46.858887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9f2c88fd-9ff9-42dd-8d20-15bfa19a1a87 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:46.860150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9f2c88fd-9ff9-42dd-8d20-15bfa19a1a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:46.869123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 692/1379] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:47.032495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506534c-f46e-4cb1-a234-a85ad6ee7755 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:47.047513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506534c-f46e-4cb1-a234-a85ad6ee7755 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:47.053997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:47.054646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:47.054925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:47.055198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:47.064440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:47.066447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9560d-f1c1-4568-b7ef-b88abfdd12e1 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:47.077294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 688/1380] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:47 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:48.598198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f285e-4008-437a-a8fc-096157ccad40 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:48.599076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f285e-4008-437a-a8fc-096157ccad40 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:48.599076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f285e-4008-437a-a8fc-096157ccad40 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:48.600745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 693/1381] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:48.607783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186090c-44c2-4e54-bdd7-de27b39e17c9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:48.608361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186090c-44c2-4e54-bdd7-de27b39e17c9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:48.608361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186090c-44c2-4e54-bdd7-de27b39e17c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:48.627043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9186090c-44c2-4e54-bdd7-de27b39e17c9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:48.647877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9186090c-44c2-4e54-bdd7-de27b39e17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:48.647877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 689/1382] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:59:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:48.795518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f285e-4008-437a-a8fc-096157ccad40 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:48.810786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f285e-4008-437a-a8fc-096157ccad40 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:48.817374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:48.817931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:48.818271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:48.818694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:48.831038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:48.833416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27e77c-ed1c-47a3-a1cd-3778b85e8ab4 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:48.843368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 694/1383] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:50.992891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19241-dd48-4381-b771-fdb6a2f310a2 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:50.993469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19241-dd48-4381-b771-fdb6a2f310a2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:50.993469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19241-dd48-4381-b771-fdb6a2f310a2 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:50.995304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 690/1384] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:59:51.002899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f18b-847c-4158-95b4-84a33377a3e5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:51.003435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f18b-847c-4158-95b4-84a33377a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:51.003538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f18b-847c-4158-95b4-84a33377a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:51.021707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6a96f18b-847c-4158-95b4-84a33377a3e5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:51.022887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6a96f18b-847c-4158-95b4-84a33377a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:51.030706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 695/1385] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:59:51.070870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19241-dd48-4381-b771-fdb6a2f310a2 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:51.082797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19241-dd48-4381-b771-fdb6a2f310a2 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:51.086696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:51.087331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:51.087609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:51.087948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:51.098217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:51.099727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecc9d7-3df2-495f-8d60-d9d654d900de service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:51.109498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 691/1386] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:51 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:53.609086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4d8d4-f122-4dbd-b2e7-07325b684caa None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:53.609820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4d8d4-f122-4dbd-b2e7-07325b684caa None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:53.609820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4d8d4-f122-4dbd-b2e7-07325b684caa None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:53.611454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 696/1387] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:53.619678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023da58-8388-499d-8f1c-8edadec0f1b9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:53.620232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023da58-8388-499d-8f1c-8edadec0f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:53.620331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023da58-8388-499d-8f1c-8edadec0f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:53.639196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d023da58-8388-499d-8f1c-8edadec0f1b9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:53.640428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d023da58-8388-499d-8f1c-8edadec0f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:53.649134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 692/1388] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:53.690134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4d8d4-f122-4dbd-b2e7-07325b684caa None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:53.705317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4d8d4-f122-4dbd-b2e7-07325b684caa None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:53.709752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:53.710392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:53.710670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:53.710940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:53.721339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:53.723145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b398-2990-4d11-96c1-4fe95400f739 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:53.734263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 697/1389] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:56.464496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37536d-be1c-4f2e-8b64-9d3c14792c35 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:56.465052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37536d-be1c-4f2e-8b64-9d3c14792c35 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:56.466053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37536d-be1c-4f2e-8b64-9d3c14792c35 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:56.468263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 693/1390] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:56.476615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4470-bf3c-4a8f-a1c7-a0e983b70d71 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:56.477130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4470-bf3c-4a8f-a1c7-a0e983b70d71 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:56.477234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c4470-bf3c-4a8f-a1c7-a0e983b70d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:56.495432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a08c4470-bf3c-4a8f-a1c7-a0e983b70d71 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:56.496682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a08c4470-bf3c-4a8f-a1c7-a0e983b70d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:56.505439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 698/1391] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:56.547550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37536d-be1c-4f2e-8b64-9d3c14792c35 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:56.558709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37536d-be1c-4f2e-8b64-9d3c14792c35 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:56.562395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:56.563029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:56.563313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:56.563588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:56.574025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:56.575596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54cf8e-de67-4618-85e0-2f3fa521af72 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:56.588617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 694/1392] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:58.975994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71831a5-c084-453f-90be-19638bf625c2 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:58.976680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71831a5-c084-453f-90be-19638bf625c2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:58.976680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71831a5-c084-453f-90be-19638bf625c2 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:58.978386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 699/1393] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:59:58.986243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c715-4425-4fbf-8cdb-628f0875b307 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:58.988231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c715-4425-4fbf-8cdb-628f0875b307 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:58.988231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451c715-4425-4fbf-8cdb-628f0875b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:59.009640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e451c715-4425-4fbf-8cdb-628f0875b307 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:59:59.010892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e451c715-4425-4fbf-8cdb-628f0875b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:59:59.019529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 695/1394] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:59:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:59:59.061006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71831a5-c084-453f-90be-19638bf625c2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:59:59.072680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71831a5-c084-453f-90be-19638bf625c2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:59:59.076380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:59:59.077056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:59:59.077340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:59:59.077621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:59:59.087271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:59:59.088758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141bcf4-7450-4af9-b5ed-3481981e83a3 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:59:59.099635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 700/1395] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 01:59:59 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:01.428691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a170b-a757-465b-aeb1-bdcefa281506 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:01.429274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a170b-a757-465b-aeb1-bdcefa281506 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:01.429274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a170b-a757-465b-aeb1-bdcefa281506 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:01.431006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 696/1396] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:00:01.438873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa493-596f-4135-93e8-b85be3cd9535 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:01.439336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa493-596f-4135-93e8-b85be3cd9535 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:01.439456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa493-596f-4135-93e8-b85be3cd9535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:01.458698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-91daa493-596f-4135-93e8-b85be3cd9535 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:01.459922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-91daa493-596f-4135-93e8-b85be3cd9535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:01.468173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 701/1397] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:01.508288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a170b-a757-465b-aeb1-bdcefa281506 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:01.520048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a170b-a757-465b-aeb1-bdcefa281506 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:01.523782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:01.524446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:01.524726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:01.525000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:01.534959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:01.536429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddf82e-d011-46b7-a45b-e6e4ac9755ab service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:01.546017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 697/1398] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:03.904889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc172-c1a4-4083-8ce0-01b64ddecf18 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:03.906320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc172-c1a4-4083-8ce0-01b64ddecf18 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:03.906320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc172-c1a4-4083-8ce0-01b64ddecf18 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:03.907235 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 702/1399] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:03.920926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073470f2-928e-4e3f-9cd6-c8be9d14c4c2 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:03.920926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073470f2-928e-4e3f-9cd6-c8be9d14c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:03.920926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073470f2-928e-4e3f-9cd6-c8be9d14c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:03.934700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-073470f2-928e-4e3f-9cd6-c8be9d14c4c2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:03.935896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-073470f2-928e-4e3f-9cd6-c8be9d14c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:03.945325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 698/1400] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:03.986785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc172-c1a4-4083-8ce0-01b64ddecf18 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:03.998547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc172-c1a4-4083-8ce0-01b64ddecf18 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:04.002103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:04.002930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:04.003425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:04.003709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:04.013576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:04.018663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffbb17-58ac-4522-8be2-9a7ff95c1c31 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:04.025376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 703/1401] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:06.359765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5700121-4086-4cfe-a3f7-c744ab806d6b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:06.360498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5700121-4086-4cfe-a3f7-c744ab806d6b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:06.360498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5700121-4086-4cfe-a3f7-c744ab806d6b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:06.362895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 699/1402] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:06.371163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb419-3f8e-4aab-a10c-dc5ad4757869 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:06.371684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb419-3f8e-4aab-a10c-dc5ad4757869 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:06.371684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bb419-3f8e-4aab-a10c-dc5ad4757869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:06.390234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8d9bb419-3f8e-4aab-a10c-dc5ad4757869 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:06.391440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8d9bb419-3f8e-4aab-a10c-dc5ad4757869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:06.399599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 704/1403] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:06.440110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5700121-4086-4cfe-a3f7-c744ab806d6b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:06.451095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5700121-4086-4cfe-a3f7-c744ab806d6b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:06.455214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:06.455862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:06.456349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:06.456650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:06.467356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:06.468831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732d44-65b3-4500-818f-7733785c1380 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:06.479411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 700/1404] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:08.790446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38523d-889a-4067-973f-63a1f09a5f85 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:08.791085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38523d-889a-4067-973f-63a1f09a5f85 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:08.791085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38523d-889a-4067-973f-63a1f09a5f85 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:08.792859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 705/1405] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:08.801186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828adf9-4614-4b9a-83db-63c04dc5353e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:08.801666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828adf9-4614-4b9a-83db-63c04dc5353e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:08.801666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828adf9-4614-4b9a-83db-63c04dc5353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:08.819690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7828adf9-4614-4b9a-83db-63c04dc5353e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:08.820906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7828adf9-4614-4b9a-83db-63c04dc5353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:08.829005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 701/1406] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:08 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:08.868590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38523d-889a-4067-973f-63a1f09a5f85 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:08.879516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38523d-889a-4067-973f-63a1f09a5f85 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:08.883091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:08.883720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:08.884032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:08.884310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:08.893294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:08.894716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3ff05-045e-4180-9daf-f17d2dc68586 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:08.903944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 706/1407] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:08 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:11.200322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5000b-ff24-4afc-930a-36b2db7a4897 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:11.200873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5000b-ff24-4afc-930a-36b2db7a4897 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:11.200873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5000b-ff24-4afc-930a-36b2db7a4897 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:11.202646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 702/1408] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:00:11.211273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6210e-782a-44eb-bab3-197b54bd51f1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:11.211797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6210e-782a-44eb-bab3-197b54bd51f1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:11.211797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6210e-782a-44eb-bab3-197b54bd51f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:11.231016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a4f6210e-782a-44eb-bab3-197b54bd51f1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:11.232255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a4f6210e-782a-44eb-bab3-197b54bd51f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:11.240357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 707/1409] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:11.278749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5000b-ff24-4afc-930a-36b2db7a4897 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:11.290789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5000b-ff24-4afc-930a-36b2db7a4897 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:11.294471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:11.295140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:11.295407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:11.295686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:11.305526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:11.306981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f01ae-b735-4275-9d97-2400430b6efd service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:11.317207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 703/1410] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:11 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:00:13.607278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca9f7-7754-4142-bd93-70ef725d35ff None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:13.607845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca9f7-7754-4142-bd93-70ef725d35ff None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:13.607845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca9f7-7754-4142-bd93-70ef725d35ff None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:13.610784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 708/1411] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:13.621541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa716-356f-4709-9c15-f1aad5196ec4 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:13.622998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa716-356f-4709-9c15-f1aad5196ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:13.622998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aa716-356f-4709-9c15-f1aad5196ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:13.641673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-449aa716-356f-4709-9c15-f1aad5196ec4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:13.643526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-449aa716-356f-4709-9c15-f1aad5196ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:13.656338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 704/1412] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:00:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:13.695954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cca9f7-7754-4142-bd93-70ef725d35ff None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:13.708120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cca9f7-7754-4142-bd93-70ef725d35ff None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:13.713997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:13.714670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:13.714973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:13.715360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:13.726517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:13.728017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e23076-62f3-48ae-8f60-752a51b81b40 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:13.738424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 709/1413] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:26.637981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9187-667b-4695-bbb6-c88fbc0ad76d None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.638581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9187-667b-4695-bbb6-c88fbc0ad76d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.638581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab9187-667b-4695-bbb6-c88fbc0ad76d None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.640399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 705/1414] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:26.647310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52193c4-be49-4472-8680-7ae1be1a5b6c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.647775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52193c4-be49-4472-8680-7ae1be1a5b6c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.647882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52193c4-be49-4472-8680-7ae1be1a5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.665443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b52193c4-be49-4472-8680-7ae1be1a5b6c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:26.666629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b52193c4-be49-4472-8680-7ae1be1a5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.674448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 710/1415] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:26.723461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ddc47-60c5-4ad5-8700-cfe13f8e4d5a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.723752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ddc47-60c5-4ad5-8700-cfe13f8e4d5a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.724074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ddc47-60c5-4ad5-8700-cfe13f8e4d5a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.725837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 706/1416] 10.222.0.79 () {54 vars in 961 bytes} [Fri Jan 28 02:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:26.731090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14e98-146b-4434-9e87-f382ca6e4ce1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.731388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14e98-146b-4434-9e87-f382ca6e4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.731712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa14e98-146b-4434-9e87-f382ca6e4ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.749573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2aa14e98-146b-4434-9e87-f382ca6e4ce1 None None] MFA Rules not processed for user `d6a1d87117d143488e1701ac0407ff28`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:26.750790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2aa14e98-146b-4434-9e87-f382ca6e4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:26.757820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 711/1417] 10.222.0.79 () {58 vars in 1058 bytes} [Fri Jan 28 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:26.765368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ddc47-60c5-4ad5-8700-cfe13f8e4d5a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:26.776538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ddc47-60c5-4ad5-8700-cfe13f8e4d5a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:26.780045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:26.780665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:26.780948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:26.781224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:26.789959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:26.791374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f4ffb-f54b-43f9-8788-11060cfb839d service glance] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:26.801143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 707/1418] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:26 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:29.106904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfb35-5b84-453d-8aa2-228978568f97 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:29.107695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfb35-5b84-453d-8aa2-228978568f97 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:29.107695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bfb35-5b84-453d-8aa2-228978568f97 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:29.109286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 712/1419] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:29.116884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fc2c-2744-450a-96ec-a42e83091383 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:29.117359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fc2c-2744-450a-96ec-a42e83091383 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:29.117469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254fc2c-2744-450a-96ec-a42e83091383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:29.137051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e254fc2c-2744-450a-96ec-a42e83091383 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:29.138249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e254fc2c-2744-450a-96ec-a42e83091383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:29.146683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 708/1420] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:29.170362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bfb35-5b84-453d-8aa2-228978568f97 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:29.183092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bfb35-5b84-453d-8aa2-228978568f97 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:29.187472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:29.188150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:29.188481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:29.189397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:29.190120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:29.191992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a7e4-4443-4d8a-9bb7-892ac18fee0f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:29.205424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 713/1421] 10.222.0.79 () {56 vars in 1108 bytes} [Fri Jan 28 02:00:29 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:00:31.437030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b823-a089-4bf9-9f9c-fec6a664ee87 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:31.437597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b823-a089-4bf9-9f9c-fec6a664ee87 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:31.437597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b823-a089-4bf9-9f9c-fec6a664ee87 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:31.440369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 709/1422] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:31.447647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f32cb-ab6e-4648-9d67-42ba7114fdd3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:31.448097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f32cb-ab6e-4648-9d67-42ba7114fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:31.448246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f32cb-ab6e-4648-9d67-42ba7114fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:31.466189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-fb5f32cb-ab6e-4648-9d67-42ba7114fdd3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:31.467726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fb5f32cb-ab6e-4648-9d67-42ba7114fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:31.475544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 714/1423] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:31.520084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b823-a089-4bf9-9f9c-fec6a664ee87 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:31.534859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b823-a089-4bf9-9f9c-fec6a664ee87 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:31.540274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:31.540899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:31.541181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:31.541452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:31.550468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:31.552079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e0937-99d6-47a6-b3da-cb4cb890cf4d service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:31.561236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 710/1424] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:31 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:33.952808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348572-9132-4d0d-ad87-66a3224718ed None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:33.953438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348572-9132-4d0d-ad87-66a3224718ed None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:33.953438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b348572-9132-4d0d-ad87-66a3224718ed None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:33.955761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 715/1425] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:33.964293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835dadc-79db-4f7b-8bc0-0619dbbcdb5a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:33.965138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835dadc-79db-4f7b-8bc0-0619dbbcdb5a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:33.965138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835dadc-79db-4f7b-8bc0-0619dbbcdb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:33.984102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2835dadc-79db-4f7b-8bc0-0619dbbcdb5a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:33.986021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2835dadc-79db-4f7b-8bc0-0619dbbcdb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:33.994304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 711/1426] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:34.036004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348572-9132-4d0d-ad87-66a3224718ed None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:34.047280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b348572-9132-4d0d-ad87-66a3224718ed None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:34.052309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:34.052993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:34.053276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:34.053553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:34.064839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:34.066302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd030-530f-4066-8c64-704154e0e2c2 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:34.081931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 716/1427] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:34 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:00:36.384973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91de6-19b4-4f47-8b81-efe0c7c52959 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.385512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91de6-19b4-4f47-8b81-efe0c7c52959 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.385512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91de6-19b4-4f47-8b81-efe0c7c52959 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.387220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 712/1428] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:36.395220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c1fd-02e9-47c9-b2c4-9c1132a4d61d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.395767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c1fd-02e9-47c9-b2c4-9c1132a4d61d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.395767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c1fd-02e9-47c9-b2c4-9c1132a4d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.413645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9b22c1fd-02e9-47c9-b2c4-9c1132a4d61d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:36.414852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9b22c1fd-02e9-47c9-b2c4-9c1132a4d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:36.422699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 717/1429] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:36 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:00:36.461925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b91de6-19b4-4f47-8b81-efe0c7c52959 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:36.473160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b91de6-19b4-4f47-8b81-efe0c7c52959 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:36.476720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:36.477344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:36.477630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:36.477938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:36.486767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:36.488214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4c50a-2eab-4a7e-97fc-c568c4304e03 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:36.497472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 713/1430] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:36 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:00:38.846616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b93f-bc6e-4c3d-bf4e-f8f1bede2c49 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:38.847197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b93f-bc6e-4c3d-bf4e-f8f1bede2c49 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:38.847197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b93f-bc6e-4c3d-bf4e-f8f1bede2c49 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:38.849020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 718/1431] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:38.856543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8704-bfad-41e6-bfcd-10d4c243992d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:38.856967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8704-bfad-41e6-bfcd-10d4c243992d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:38.857099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f8704-bfad-41e6-bfcd-10d4c243992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:38.875702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-988f8704-bfad-41e6-bfcd-10d4c243992d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:38.877127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-988f8704-bfad-41e6-bfcd-10d4c243992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:38.884987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 714/1432] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:38.927290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b93f-bc6e-4c3d-bf4e-f8f1bede2c49 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:38.938127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b93f-bc6e-4c3d-bf4e-f8f1bede2c49 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:38.941914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:38.942526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:38.942804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:38.943077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:38.952290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:38.954758 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42517d41-6e01-4128-9fdf-15c9416c9eb4 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:38.963535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 719/1433] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:00:41.723146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270534d-5d32-4892-9f1d-1e548314d688 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:41.723752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270534d-5d32-4892-9f1d-1e548314d688 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:41.723752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270534d-5d32-4892-9f1d-1e548314d688 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:41.725547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 715/1434] 10.222.0.79 () {54 vars in 926 bytes} [Fri Jan 28 02:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:00:41.733071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5824-9adb-48b0-b1c5-3fe1852529e2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:41.733632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5824-9adb-48b0-b1c5-3fe1852529e2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:41.733632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5824-9adb-48b0-b1c5-3fe1852529e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:41.751782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-37fc5824-9adb-48b0-b1c5-3fe1852529e2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:00:41.753017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-37fc5824-9adb-48b0-b1c5-3fe1852529e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:00:41.760646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 720/1435] 10.222.0.79 () {58 vars in 1023 bytes} [Fri Jan 28 02:00:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:00:41.801743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270534d-5d32-4892-9f1d-1e548314d688 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:00:41.812734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270534d-5d32-4892-9f1d-1e548314d688 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:00:41.816520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:00:41.817152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:00:41.817435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:00:41.817712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:00:41.826930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:00:41.828433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad7bb0-f1c5-4b75-ac9c-809eadb602cd service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:00:41.837816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 716/1436] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:00:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:09.006083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.006694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.006694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.025199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:09.026380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:09.034821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 721/1437] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:02:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:09.042889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.043474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.043718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.061598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:09.062798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:09.070642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 717/1438] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:02:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:02:09.075930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.085336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cd4e6-1e6d-4082-842b-6296b9ad4546 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.089951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.091675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.092048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.092327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.093034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:02:09.093338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.094910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.106323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 722/1439] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:02:09.114406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.123683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08e5c4-1ebf-408c-adc3-ca64fa0829a9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.128266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.128902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.129183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.129462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.130194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.132098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.233694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 718/1440] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:02:09 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:09.237838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.247710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3426e4-2fca-4577-93d8-f174fa63f4ca admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.301860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.302451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.302749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.303029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.303711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.305678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.439321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 723/1441] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:02:09 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:02:09.443461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.454784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b70668-df89-4f71-9cf1-03c45e5f6ff2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.459659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.464716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.464716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.464716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.464716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.464716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.476759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 719/1442] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:02:09.481061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.491182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f08be6-5413-4a56-ab10-1bd904494930 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.495813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.497212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.497493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.497767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.498532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.500149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd3d19-93c7-4b46-8a7d-a158d100fc4a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.514009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 724/1443] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:02:09.518422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.528538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6e30d-f99c-48bd-912d-8c3ef3a34fe2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.533133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.533997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.534280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.534558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] PATH_INFO: `/v3/projects/cea96236217943469a79fe4e139766a3/users/a212bccdbd744893999f3d8148f2cf42/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.549042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea96236217943469a79fe4e139766a3, user_id=a212bccdbd744893999f3d8148f2cf42, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.551655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.632966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 720/1444] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:02:09 2022] PUT /identity/v3/projects/cea96236217943469a79fe4e139766a3/users/a212bccdbd744893999f3d8148f2cf42/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:09.653887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791a65-360a-496e-81be-ca98a42e38d4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.654169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791a65-360a-496e-81be-ca98a42e38d4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.654443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791a65-360a-496e-81be-ca98a42e38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.680819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c0791a65-360a-496e-81be-ca98a42e38d4 None None] MFA Rules not processed for user `a212bccdbd744893999f3d8148f2cf42`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:09.682026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c0791a65-360a-496e-81be-ca98a42e38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:09.745364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 725/1445] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:02:09 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:09.757235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.826740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50a1-ce4c-4cd7-8f08-bc984afe4fed admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.832265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.832911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.833196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.833493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.842408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.844025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:09.852656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 721/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:09 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:09.922024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6065-207c-4754-8449-4f7dca3b51e4 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.922322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6065-207c-4754-8449-4f7dca3b51e4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.922590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a6065-207c-4754-8449-4f7dca3b51e4 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.924347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 726/1447] 10.222.0.79 () {52 vars in 829 bytes} [Fri Jan 28 02:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:02:09.927994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:09.988708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f51c-8d97-4cf1-9086-e2d2456f182e service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:09.993434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:09.994313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:09.994595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:09.994871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] PATH_INFO: `/v3/users/a212bccdbd744893999f3d8148f2cf42` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:09.996382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a212bccdbd744893999f3d8148f2cf42)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:09.997501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:09.997501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 02:02:09.997501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 02:02:09.998714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:10.240925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a212bccdbd744893999f3d8148f2cf42'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:10.253717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a212bccdbd744893999f3d8148f2cf42'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:10.276038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a212bccdbd744893999f3d8148f2cf42'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:10.362594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a212bccdbd744893999f3d8148f2cf42'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:10.363306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a212bccdbd744893999f3d8148f2cf42'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:10.370239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 722/1448] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:02:09 2022] DELETE /identity/v3/users/a212bccdbd744893999f3d8148f2cf42 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:02:10.375276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:10.375743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:10.375852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:10.393561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:02:10.394689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:10.451640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 727/1449] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:02:10 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:02:10.461392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:10.462804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:10.520940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dde2f-07af-4ae2-a7de-f1698d2033af admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:10.525114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:10.525757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:10.526045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:10.526324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:10.535409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:10.536898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b13c1-4064-494f-88a6-c17eab259b16 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:10.547099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 723/1450] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:02:10 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:02:11.047050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:02:11.048618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:02:11.061942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591701-c91c-498d-9a77-4c2efa4a07f0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:02:11.066757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:02:11.067603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:02:11.067879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:02:11.068184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] PATH_INFO: `/v3/projects/cea96236217943469a79fe4e139766a3` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:02:11.069431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea96236217943469a79fe4e139766a3)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:02:11.070480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:02:11.070480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 02:02:11.070480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 02:02:11.071760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:02:11.194083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea96236217943469a79fe4e139766a3', 'request_id': 'req-adffcdac-f535-4f1e-906e-6ae2b1451294'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:11.208120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea96236217943469a79fe4e139766a3', 'request_id': 'req-adffcdac-f535-4f1e-906e-6ae2b1451294'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:11.437102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea96236217943469a79fe4e139766a3', 'request_id': 'req-adffcdac-f535-4f1e-906e-6ae2b1451294'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:11.448948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] The token cache is being invalidate because project cea96236217943469a79fe4e139766a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:02:11.449687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:11.450746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-adffcdac-f535-4f1e-906e-6ae2b1451294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:02:11.452422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 728/1451] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:02:11 2022] DELETE /identity/v3/projects/cea96236217943469a79fe4e139766a3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:03:45.844889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e045-0e68-4dea-ba67-5fe657f400ba None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.845497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e045-0e68-4dea-ba67-5fe657f400ba None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.845600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2e045-0e68-4dea-ba67-5fe657f400ba None None] PATH_INFO: `/v3` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.847015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 724/1452] 10.222.0.95 () {54 vars in 925 bytes} [Fri Jan 28 02:03:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:03:45.871588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9381-eb69-4b0b-a86f-21d31dd01426 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:45.872088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9381-eb69-4b0b-a86f-21d31dd01426 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:45.872337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9381-eb69-4b0b-a86f-21d31dd01426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:45.891270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4daf9381-eb69-4b0b-a86f-21d31dd01426 None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:45.892506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4daf9381-eb69-4b0b-a86f-21d31dd01426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:45.953731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 729/1453] 10.222.0.95 () {58 vars in 1015 bytes} [Fri Jan 28 02:03:45 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:46.655793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.656132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.656411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.658202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 725/1454] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 02:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:03:46.664875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76070b-ed14-424a-98e8-999e1e83f39c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.665160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76070b-ed14-424a-98e8-999e1e83f39c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.665444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76070b-ed14-424a-98e8-999e1e83f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.683833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4c76070b-ed14-424a-98e8-999e1e83f39c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:46.685098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4c76070b-ed14-424a-98e8-999e1e83f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:46.743039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 730/1455] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 02:03:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:03:46.905703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:46.907441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:46.981011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5086d9-dcb9-4fa7-8f96-d997e5210ce9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:46.986527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:46.987171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:46.987453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:46.987733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:46.995775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:46.997407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b758-bbc5-4aa9-8694-4abaf54b86c6 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:47.007113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 726/1456] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:48.413129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9b58-ca39-41b7-bdb8-d6d0da232ba9 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.413669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9b58-ca39-41b7-bdb8-d6d0da232ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.413669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9b58-ca39-41b7-bdb8-d6d0da232ba9 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.415522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 731/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 02:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:03:48.421223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5de8-2652-4c36-8aaf-7e5efd219e0d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.421641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5de8-2652-4c36-8aaf-7e5efd219e0d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.421775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5de8-2652-4c36-8aaf-7e5efd219e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.442247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f28a5de8-2652-4c36-8aaf-7e5efd219e0d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:48.443463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f28a5de8-2652-4c36-8aaf-7e5efd219e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:48.451371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 727/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 02:03:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:48.614033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9b58-ca39-41b7-bdb8-d6d0da232ba9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:48.629129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9b58-ca39-41b7-bdb8-d6d0da232ba9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:48.638401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:48.639045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:48.639325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:48.639606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:48.648446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:48.650238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c0ab9-2947-45f3-8454-c34d0e7f1e38 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:48.662304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 732/1459] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:03:54.997098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00faddb-07f4-4649-8523-833728d4e4c6 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:54.997557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00faddb-07f4-4649-8523-833728d4e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:54.997809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00faddb-07f4-4649-8523-833728d4e4c6 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:54.999396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 728/1460] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 02:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:03:55.005578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda151-b273-43b4-8d4a-d6445f40dc12 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:55.006058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda151-b273-43b4-8d4a-d6445f40dc12 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:55.006201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda151-b273-43b4-8d4a-d6445f40dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:55.025386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b1fda151-b273-43b4-8d4a-d6445f40dc12 None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:03:55.026585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b1fda151-b273-43b4-8d4a-d6445f40dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:03:55.035896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 733/1461] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 02:03:55 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:03:55.043848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00faddb-07f4-4649-8523-833728d4e4c6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:03:55.057835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00faddb-07f4-4649-8523-833728d4e4c6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:03:55.062980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:03:55.063600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:03:55.063882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:03:55.064776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:03:55.073603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:03:55.075183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f1c7-c922-4dd1-8c31-6b5dd0789201 service placement] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:03:55.084988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 729/1462] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:03:55 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:00.747957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d40e-ed42-4ba1-8d56-5f5eceab023a None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:00.748578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d40e-ed42-4ba1-8d56-5f5eceab023a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:00.748578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d40e-ed42-4ba1-8d56-5f5eceab023a None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:00.750412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 734/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 02:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:00.756748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7d7b-b736-4b41-b162-2d5983c85fb5 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:00.757222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7d7b-b736-4b41-b162-2d5983c85fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:00.757325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7d7b-b736-4b41-b162-2d5983c85fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:00.776153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-127f7d7b-b736-4b41-b162-2d5983c85fb5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:00.777369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-127f7d7b-b736-4b41-b162-2d5983c85fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:00.786479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 730/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 02:04:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:00.942033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01d40e-ed42-4ba1-8d56-5f5eceab023a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:00.958740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01d40e-ed42-4ba1-8d56-5f5eceab023a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:00.964506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:00.965164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:00.965450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:00.965728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:00.975528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:00.977169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2d4bf-bfaa-4ffc-9e58-9ce892429718 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:00.987025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 735/1465] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:02.387613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c904f-954b-4a3f-820a-aa6badab6191 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:02.388224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c904f-954b-4a3f-820a-aa6badab6191 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:02.388224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c904f-954b-4a3f-820a-aa6badab6191 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:02.389941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 731/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 02:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:04:02.395433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be727e-5b73-49f5-89d9-52d2b42a0682 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:02.396003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be727e-5b73-49f5-89d9-52d2b42a0682 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:02.396120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be727e-5b73-49f5-89d9-52d2b42a0682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:02.415331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c5be727e-5b73-49f5-89d9-52d2b42a0682 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:02.416539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c5be727e-5b73-49f5-89d9-52d2b42a0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:02.426858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 736/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 02:04:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:02.588253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c904f-954b-4a3f-820a-aa6badab6191 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:02.603249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c904f-954b-4a3f-820a-aa6badab6191 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:02.609116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:02.609752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:02.610040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:02.610320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:02.619843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:02.621474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeec508-913a-4260-8bb2-c62541c382ee service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:02.632115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 732/1468] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:02 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:06.673785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.674387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.674387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.676231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 737/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:06.683572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d698c2-5fdf-4ca7-8cd8-9099918d906d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.684036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d698c2-5fdf-4ca7-8cd8-9099918d906d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.684185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d698c2-5fdf-4ca7-8cd8-9099918d906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.701834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a4d698c2-5fdf-4ca7-8cd8-9099918d906d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:06.703070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a4d698c2-5fdf-4ca7-8cd8-9099918d906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:06.711125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 733/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:04:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:06.750148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:06.752330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:06.810690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606f578-0c8f-43fa-9fd0-f7c8765e93b4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:06.814547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:06.815147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:06.815427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:06.815698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:06.825267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:06.826709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb1b9a-ba84-4629-9bf8-287301023558 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:06.837114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 738/1471] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:09.057122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e99ade-1e48-49a6-b7bb-d637c0c9aec5 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:09.057704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e99ade-1e48-49a6-b7bb-d637c0c9aec5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:09.057704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e99ade-1e48-49a6-b7bb-d637c0c9aec5 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:09.059460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 734/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:09.066661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52a3a-7fc3-498b-a851-58bad23cba24 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:09.067114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52a3a-7fc3-498b-a851-58bad23cba24 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:09.067222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52a3a-7fc3-498b-a851-58bad23cba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:09.085650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9af52a3a-7fc3-498b-a851-58bad23cba24 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:09.086840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9af52a3a-7fc3-498b-a851-58bad23cba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:09.095808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 739/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:04:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:09.131795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e99ade-1e48-49a6-b7bb-d637c0c9aec5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:09.143391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e99ade-1e48-49a6-b7bb-d637c0c9aec5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:09.147183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:09.147882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:09.148203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:09.148510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:09.158224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:09.159647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0548595-cc1f-46d3-b19d-fab89bc1d764 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:09.169199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 735/1474] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:12.811740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:12.812369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:12.812369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:12.814932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 740/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:12.822014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5d7f-60fa-459e-acba-19774caa7267 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:12.822447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5d7f-60fa-459e-acba-19774caa7267 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:12.822593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a5d7f-60fa-459e-acba-19774caa7267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:12.841459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f58a5d7f-60fa-459e-acba-19774caa7267 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:12.842644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f58a5d7f-60fa-459e-acba-19774caa7267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:12.850475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 736/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:04:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:12.902705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:12.904426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:12.960078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80c3c7-8a22-4705-9a7f-839915ba2bdb None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:12.963583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:12.964498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:12.964778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:12.965073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:12.973940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:12.975312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0803e-7cea-4abc-8a9a-2913516e4ef5 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:12.985372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 741/1477] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:04:15.182762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452157b-123b-4188-b320-378bb0a6ba11 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.183276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452157b-123b-4188-b320-378bb0a6ba11 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.183387 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452157b-123b-4188-b320-378bb0a6ba11 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.185132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 737/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 02:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:15.192658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50594-96fc-4c7f-925a-81a590df650c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.193113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50594-96fc-4c7f-925a-81a590df650c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.193213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50594-96fc-4c7f-925a-81a590df650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.210973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-93f50594-96fc-4c7f-925a-81a590df650c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:15.212210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-93f50594-96fc-4c7f-925a-81a590df650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:15.220775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 742/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:15.270517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f44d3-5357-46e0-9840-b37b74bf3f26 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.270806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f44d3-5357-46e0-9840-b37b74bf3f26 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.271084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f44d3-5357-46e0-9840-b37b74bf3f26 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.272878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 738/1480] 10.222.0.79 () {54 vars in 962 bytes} [Fri Jan 28 02:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:04:15.278280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d483-c2ad-4822-991b-e1f128a1083c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.278605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d483-c2ad-4822-991b-e1f128a1083c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.278887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8d483-c2ad-4822-991b-e1f128a1083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.298232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e8b8d483-c2ad-4822-991b-e1f128a1083c None None] MFA Rules not processed for user `8912268c49fc4532a9b920995b286ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:04:15.299464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e8b8d483-c2ad-4822-991b-e1f128a1083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:04:15.306071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 743/1481] 10.222.0.79 () {58 vars in 1059 bytes} [Fri Jan 28 02:04:15 2022] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:04:15.315503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f44d3-5357-46e0-9840-b37b74bf3f26 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:04:15.326848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f44d3-5357-46e0-9840-b37b74bf3f26 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:04:15.331271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:04:15.331906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:04:15.332225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:04:15.332504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:04:15.341776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:04:15.343206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287119a4-46fa-434e-bc68-6bba807c4d4e service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:04:15.353376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 739/1482] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:04:15 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:56.178025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de52b-1b07-4fa9-a5ef-3cccabb570de None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.179099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4af7-db8b-4f86-8b34-eb761510795f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.179099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4af7-db8b-4f86-8b34-eb761510795f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.179859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b4af7-db8b-4f86-8b34-eb761510795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.180775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de52b-1b07-4fa9-a5ef-3cccabb570de None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.181492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de52b-1b07-4fa9-a5ef-3cccabb570de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.206415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-259b4af7-db8b-4f86-8b34-eb761510795f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.207658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-259b4af7-db8b-4f86-8b34-eb761510795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.209217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fe3de52b-1b07-4fa9-a5ef-3cccabb570de None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.210578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fe3de52b-1b07-4fa9-a5ef-3cccabb570de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.226662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 744/1483] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.229535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 740/1484] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.234240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.234716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.235010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.249056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.256740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.256740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.258000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.259466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.268939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 745/1485] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.277428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.283265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.284912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.294037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe8780-fde4-42be-a0ae-159e0fd27a3b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.294298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 741/1486] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:05:56.300832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.310134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.314240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.314240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.314240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.314240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:56.314240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.315471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.316893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e2887-01a3-41e1-ab5e-75faa9266426 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.328016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.328016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.328016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.328016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.328515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:56.328515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.329689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.335089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 746/1487] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:56.352896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 742/1488] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:56.356375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.371126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939460c4-f8b8-4c21-ac0c-c41a21580609 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.375991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.379716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.381116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.381567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.382004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.382895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.385118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa4e1-11dc-4f50-8bf2-51bfa2921644 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.396433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad4009-5919-42d3-8613-7e4f4b9fbd56 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.410137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.411104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.411396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.411674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.412430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.414499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.536579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 747/1489] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:56.538924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e22c-d3d0-4ac0-b0b4-f7c0267c1e80 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.539435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e22c-d3d0-4ac0-b0b4-f7c0267c1e80 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.539955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e22c-d3d0-4ac0-b0b4-f7c0267c1e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.589587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 743/1490] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:05:56.590439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.605928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9932e22c-d3d0-4ac0-b0b4-f7c0267c1e80 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.607945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9932e22c-d3d0-4ac0-b0b4-f7c0267c1e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.670671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dc608-44b1-4d74-8447-ba8638bdcc1f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.684297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.685373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.685880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.686372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.687313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.690455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.746080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 748/1491] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.748303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab185-1988-49a2-a8cf-05bff3b79b89 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.748981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab185-1988-49a2-a8cf-05bff3b79b89 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.749491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab185-1988-49a2-a8cf-05bff3b79b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.771791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2b5ab185-1988-49a2-a8cf-05bff3b79b89 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.773502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2b5ab185-1988-49a2-a8cf-05bff3b79b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.784906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 744/1492] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:56.785932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.786087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 749/1493] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.787707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb53b-5c00-4442-b3ea-48d3c8480b94 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.788017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb53b-5c00-4442-b3ea-48d3c8480b94 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.788305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb53b-5c00-4442-b3ea-48d3c8480b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.804736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9853a0-aebb-4349-94a7-18ecc4713b27 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.807568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-dbceb53b-5c00-4442-b3ea-48d3c8480b94 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.809449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dbceb53b-5c00-4442-b3ea-48d3c8480b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.810465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.811176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.811516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.811737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.812567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.817744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a2425-2abd-4ada-8193-bf72940a3239 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.822751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 750/1494] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.823847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d234ae-1025-457b-941f-11fa4f74a44f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.824276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d234ae-1025-457b-941f-11fa4f74a44f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.824557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d234ae-1025-457b-941f-11fa4f74a44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.843671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-34d234ae-1025-457b-941f-11fa4f74a44f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.849374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-34d234ae-1025-457b-941f-11fa4f74a44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.853003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 751/1495] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.854042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f324-57f7-4d71-bfcc-7d8710e60a4d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.854631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f324-57f7-4d71-bfcc-7d8710e60a4d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.854847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f324-57f7-4d71-bfcc-7d8710e60a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.872379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5558f324-57f7-4d71-bfcc-7d8710e60a4d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.873565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5558f324-57f7-4d71-bfcc-7d8710e60a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.881814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 752/1496] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.883062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.883352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.883621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.901870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.903041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.911244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 753/1497] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.912027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.921361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dded1c0-d2b1-4192-ba67-d92007845a59 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:56.921531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 745/1498] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:56.923742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770920-addd-4923-a730-95f14e31d883 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.924115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770920-addd-4923-a730-95f14e31d883 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.924402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770920-addd-4923-a730-95f14e31d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.928335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:56.929020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.929308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.929585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.930341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:56.932005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ef8e7-d8fe-40d8-b473-b7fe471298b8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:56.942955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 754/1499] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:56.944241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8492-5a35-4e35-a807-e4d52fbd4c46 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.944532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8492-5a35-4e35-a807-e4d52fbd4c46 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.944811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8492-5a35-4e35-a807-e4d52fbd4c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.952029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d2770920-addd-4923-a730-95f14e31d883 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.953260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d2770920-addd-4923-a730-95f14e31d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.961771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 746/1500] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.963032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.963623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.963961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.964714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-749f8492-5a35-4e35-a807-e4d52fbd4c46 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.965825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-749f8492-5a35-4e35-a807-e4d52fbd4c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.974457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 755/1501] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.976116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88030c-070c-422d-be76-ebd135ba03e2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:56.976116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88030c-070c-422d-be76-ebd135ba03e2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:56.976345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88030c-070c-422d-be76-ebd135ba03e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:56.983141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:56.984400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:56.994076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 747/1502] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:56.994509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:56.999889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8e88030c-070c-422d-be76-ebd135ba03e2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:57.001883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8e88030c-070c-422d-be76-ebd135ba03e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:57.004480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5f524-5d57-4d7e-bd7c-6cdc10a5f5e0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.009384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.010029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.010315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.010456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 756/1503] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:57.010591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.011423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.011664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.011847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.012033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.013552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.013710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.025667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 748/1504] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.026482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.034184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:57.035365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:57.043165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 757/1505] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:57.043747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056ec7f-4afa-4492-a66e-2be17f1fd751 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.043948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.050627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.051318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.051598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.051872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.052636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.054211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.055854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cae2a-3d2a-47d1-a3dd-03b89ecba1a5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.060626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.061283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.061581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.061861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.062572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.064359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92265af4-079a-41e9-b171-146760953d19 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.064982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 749/1506] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:57.065779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.075285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d92d66-de21-4ad6-bb78-b664c0794dff admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.081234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 758/1507] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:57.081234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.081234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.081234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.081612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.081979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.082261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.082535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.083254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.083559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.085179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.098474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 750/1508] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.098734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:57.099122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.099900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:57.114658 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 759/1509] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:57.118443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.118558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4fa4-ec94-4532-af96-80649839daa3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.123459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.124161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.124448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.124725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.125464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.125774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.127894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.131431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0f1f-ef8a-4cd4-bd9c-a4d6b10eea54 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.136053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.139163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.139163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.139163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.139163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.139163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.140678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.145164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 751/1510] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.145987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.154746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 760/1511] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.155562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.161054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14813e6-83f6-4b11-a1df-01abd7f51fd3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.165945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.166226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174b64-b783-4ab2-a517-894811abe1fa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.166599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.166928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.167200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.167904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.170012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.171159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.171918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.172163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.172413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.173189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.173812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.175158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.187400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 761/1512] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.188264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.198051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd44547-f422-4e7e-adfc-d92a9dbf079d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.202635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.203274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.203556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.203829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.205232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.206808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.217305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 762/1513] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:57.218084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.227881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a441-87c7-49ce-983e-ea4b7cb35327 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.232735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.233548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.233828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.234101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] PATH_INFO: `/v3/projects/e421df28a0624265819f380d82dfb55a/users/97ac8574ea604dcba44a74871f40fc8f/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.248450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e421df28a0624265819f380d82dfb55a, user_id=97ac8574ea604dcba44a74871f40fc8f, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.254019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.255236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 752/1514] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:57.256407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.320770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2d3f4-581a-41eb-b96b-ff1b8d6860c4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.325588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.326247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.326528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.326810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.327495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.330145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.385934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 763/1515] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:57 2022] PUT /identity/v3/projects/e421df28a0624265819f380d82dfb55a/users/97ac8574ea604dcba44a74871f40fc8f/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:57.386943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.425368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 753/1516] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:57.427226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.453055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca783807-6aae-44ce-9d6d-8d2c0f630bd4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.496226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08214f4c-c4f4-4b4f-9c68-005a05026be3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.500824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.501999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.502277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.502551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.503233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.505145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.514756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.515418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.515700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.516018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.517290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:05:57.517593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.520326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.540233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 764/1517] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:05:57.541031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.550399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54a9f1-ee6d-4b7e-8863-c28193a834e8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.555001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.555662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.555944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.556246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.556915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.558828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.587488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 754/1518] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:57.588776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.645840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 765/1519] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:57.646667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.658044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a9cd7-4075-4952-9eb2-8f3b385abd69 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.710881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d79b7-8795-4589-bfe8-d8c1220c16ea admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.716110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.716987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.717132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.717258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.717525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] PATH_INFO: `/v3/projects/b22dd75c99404b48a867a48eb5d10c7d/users/891908e1e9c8409ba9e91e341d08825e/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.717645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.717970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.718236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.718926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.721556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.732979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22dd75c99404b48a867a48eb5d10c7d, user_id=891908e1e9c8409ba9e91e341d08825e, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.737216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.838671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 755/1520] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:57.838671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.850486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 766/1521] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:57 2022] PUT /identity/v3/projects/b22dd75c99404b48a867a48eb5d10c7d/users/891908e1e9c8409ba9e91e341d08825e/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:57.851843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:57.915400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6408773-bdcd-4a83-92f8-b0a342de78e0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.920406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.921271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.921618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.921900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.922591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.924610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eca39-e132-47cf-9505-ac26db06a489 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:57.924737 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca98b6-d979-486f-b5c0-60156955878e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:57.929434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:57.930136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:57.930427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:57.930708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:57.931400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:57.933380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.021026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 756/1522] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.022327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.022620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.022936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.035621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 767/1523] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:57 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.036821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.047312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44b286-ba86-4d8c-852a-4fb80f2d4121 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.049524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] MFA Rules not processed for user `97ac8574ea604dcba44a74871f40fc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:58.050727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:58.052607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.053315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.053576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.053849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.054531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.056470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.121663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 757/1524] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:58.123051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.141687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a08a78-5ae0-4bf8-83a2-c127b52443df None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.143141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.144074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.144175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.144372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.145112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.146996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.174284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 768/1525] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.174924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.240540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830f1b1-b02a-41a4-9a31-1b3ee0d749a0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.245270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.245937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.246217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.246488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.247169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.249111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a58aff-739b-4958-bb66-18edf613cdb5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.249605 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 758/1526] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.250788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.265046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22548-f2f1-4b09-84c2-2306c6bda000 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.270811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.271616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.271852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.272170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.272875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.274791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.341840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 769/1527] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.341840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.341840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.341840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.360690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:58.361910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:58.367826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 759/1528] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.369032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.371158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 770/1529] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:58.371533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.382873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29915c-28f2-4038-a03e-3e0e97b3f268 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.386413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8dc43-78a5-43e0-ad67-8a8ca3cb762e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.387705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.388403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.388740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.388966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.389767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.391362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b1864-8947-4868-b9ff-774661b7905b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.394263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.394931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.395208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.395477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.396257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.397844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.402468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 771/1530] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.403776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e769-9648-4e73-aa18-96bbaf1bf590 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.404092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e769-9648-4e73-aa18-96bbaf1bf590 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.404378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e769-9648-4e73-aa18-96bbaf1bf590 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.406277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 772/1531] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 02:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:05:58.406676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e769-9648-4e73-aa18-96bbaf1bf590 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.412653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 760/1532] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.413887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.419756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e769-9648-4e73-aa18-96bbaf1bf590 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.425257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.425915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.426086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63fe28-862c-4809-9dee-1846d1420799 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.426282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.426435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.427126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.429061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.431476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.432288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.432787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.433171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.434086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.435761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.446864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 761/1533] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.447850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.459024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdf361-7f09-470f-bfca-2194d0ad4159 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.464026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.464683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.464971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.465283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.466325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.467633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.477710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 762/1534] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.478666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.489233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b5a7-227f-4750-b8da-49ba55fdf451 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.494385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.495118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.495421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.495696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.496504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.499179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.513289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 763/1535] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.514149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.524800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 773/1536] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:58.528694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.538530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3357b-f44e-41b2-aee1-b8300b7d6233 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.543238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.543892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.544307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.544581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.545305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.546885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fce1d-6401-4467-8ed8-a061176a9eab admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.559333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 774/1537] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.560775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.561061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.561336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.573333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1280e-c8e7-4afa-b468-4e9b67d141a4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.577922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.578575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.578861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.579553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.580845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:58.582043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:58.590673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.592295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.602878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 764/1538] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:58.604158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.616434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c47d1-679b-44b6-91d0-a9e2860cde79 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.622374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.623087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.623374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.623652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.624421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.626968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.638765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 765/1539] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.639292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.649838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba1e59-5151-4c03-b623-6683ee7bf326 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.655239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.655903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.661915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.661915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.661915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.661915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.670476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 766/1540] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.671378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.684492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2392-2ba6-45a3-93a7-c9b37e8c5082 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.685757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 775/1541] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 02:05:58 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:58.686624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.691590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.692525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.693063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.693191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.693962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.695626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.698676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213181-90aa-44e4-848a-673657e38ddf None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.704586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.705742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.706301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.706691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.707471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.707937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 767/1542] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.708820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.709265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.719070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e7e2-d83f-4a80-95c6-70a797e01985 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.720979 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 776/1543] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.721805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.727493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.728248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.728532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.728846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.729596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.731257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.734930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5356f7d-9b36-402d-8cc0-0d38e4744b70 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.743347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 768/1544] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:58.743644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.744199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.744630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.744976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.745185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] PATH_INFO: `/v3/projects/6bdd27e926a84fa49844fbcca271bb19/users/a6e7ef3a7fd145e5ab8726786ba318bb/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.756573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be4345-6ed4-43c1-9942-3ee54fdb306f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.762337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.763231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.763369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdd27e926a84fa49844fbcca271bb19, user_id=a6e7ef3a7fd145e5ab8726786ba318bb, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.763553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.763782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] PATH_INFO: `/v3/projects/cc19a0f9c33f47f1b504bebbb0b2c931/users/8fd7039b8f074a13b2030a2bb7aaff94/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:58.766024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.779576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc19a0f9c33f47f1b504bebbb0b2c931, user_id=8fd7039b8f074a13b2030a2bb7aaff94, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:58.783472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:58.883393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 777/1545] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:58 2022] PUT /identity/v3/projects/6bdd27e926a84fa49844fbcca271bb19/users/a6e7ef3a7fd145e5ab8726786ba318bb/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:58.884231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.908881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 769/1546] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:58 2022] PUT /identity/v3/projects/cc19a0f9c33f47f1b504bebbb0b2c931/users/8fd7039b8f074a13b2030a2bb7aaff94/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:58.908881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:58.963043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82644f5-d07e-451a-8a3e-672eac78f4e3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.991640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6ed43-6618-4135-a14c-fe10198c6af1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:58.998402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:58.999133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:58.999484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:58.999829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.032632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.033637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.033922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.034199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] PATH_INFO: `/v3/projects/2baca0724a954f13a9b56ba19c27d747/users/fd67fdb537ad4c3aba6fdfd5a1590643/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.048918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baca0724a954f13a9b56ba19c27d747, user_id=fd67fdb537ad4c3aba6fdfd5a1590643, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.051602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.060288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.061903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.071681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 770/1547] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:58 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:59.072572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.082818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d6b06-bc98-499a-86c7-b770e2d51b47 service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.087423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.088308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.088974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.089239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] PATH_INFO: `/v3/projects/0bdc88c222864e50a0dad8b7c7f8020a/users/155e001483294448bd43569de5053f29/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.104485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdc88c222864e50a0dad8b7c7f8020a, user_id=155e001483294448bd43569de5053f29, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.110841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.159187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 778/1548] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:58 2022] PUT /identity/v3/projects/2baca0724a954f13a9b56ba19c27d747/users/fd67fdb537ad4c3aba6fdfd5a1590643/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:59.174908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.214677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 771/1549] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:59 2022] PUT /identity/v3/projects/0bdc88c222864e50a0dad8b7c7f8020a/users/155e001483294448bd43569de5053f29/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:59.218676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.257708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c114-a7e8-4da1-9376-7e298e452aec admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.318837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263e2a5-00b9-4794-8112-3e5928295d20 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.323884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.327655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.327655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.327655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.327655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.327655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2c11-b4f9-4699-b6f1-13cb0fba203a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.328336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.330579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.330972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.331216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] PATH_INFO: `/v3/projects/7c900f58243346da8226fb907a41c600/users/3402e3b89ec6416ca95650d3bacc6a88/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.339036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 772/1550] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:05:59.340269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eada98-88a2-4895-8512-87f7cb8ee143 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.340541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eada98-88a2-4895-8512-87f7cb8ee143 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.340980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eada98-88a2-4895-8512-87f7cb8ee143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.352653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c900f58243346da8226fb907a41c600, user_id=3402e3b89ec6416ca95650d3bacc6a88, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.355483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01aac50-7903-4fb5-9700-12e948705695 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.359393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-59eada98-88a2-4895-8512-87f7cb8ee143 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.361411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-59eada98-88a2-4895-8512-87f7cb8ee143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.369494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 773/1551] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:59.373964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d536be6-de8c-4fe4-b2c6-19cbabf0892c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.379320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d536be6-de8c-4fe4-b2c6-19cbabf0892c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.379320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d536be6-de8c-4fe4-b2c6-19cbabf0892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.394693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4d536be6-de8c-4fe4-b2c6-19cbabf0892c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.396568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4d536be6-de8c-4fe4-b2c6-19cbabf0892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.405141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 774/1552] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:59.406497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.406786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.407104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.434845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] MFA Rules not processed for user `fd67fdb537ad4c3aba6fdfd5a1590643`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.436258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.470536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 779/1553] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:59 2022] PUT /identity/v3/projects/7c900f58243346da8226fb907a41c600/users/3402e3b89ec6416ca95650d3bacc6a88/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:59.472461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44f1a-9a28-49cd-a1a8-bbbbb7c300ab None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.472916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44f1a-9a28-49cd-a1a8-bbbbb7c300ab None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.473368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44f1a-9a28-49cd-a1a8-bbbbb7c300ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.509529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b4d44f1a-9a28-49cd-a1a8-bbbbb7c300ab None None] MFA Rules not processed for user `155e001483294448bd43569de5053f29`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.511127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b4d44f1a-9a28-49cd-a1a8-bbbbb7c300ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.515943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 775/1554] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:59.517062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.527711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081e82-7536-452b-b7fd-316dc208f8a1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.582771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 780/1555] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:59.584216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.584608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.584986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.586832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 781/1556] 10.222.0.79 () {54 vars in 912 bytes} [Fri Jan 28 02:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:05:59.588100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.591207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.591425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.591425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.591425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] PATH_INFO: `/v3/projects/0abe012ba65845329098e0e06c54b9c1/users/acab2a0c4a0e48909317791a3de85b53/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.592577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.606893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abe012ba65845329098e0e06c54b9c1, user_id=acab2a0c4a0e48909317791a3de85b53, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.609713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.654590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7975ac-73dc-4b71-90dc-6e7c0cce7c23 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.659028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.659678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.659957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.660285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.670109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.671728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdbd74-e01b-4150-b1bb-17c84c32b0e8 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.679624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 776/1557] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:05:59 2022] PUT /identity/v3/projects/0abe012ba65845329098e0e06c54b9c1/users/acab2a0c4a0e48909317791a3de85b53/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:05:59.680664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.683273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 782/1558] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:59 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:59.684557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.684903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.685182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.703580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.706847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.754053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f746-65b0-4f4d-905b-fc6d8da2a599 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.757814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.758641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.758921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.759242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.788353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 783/1559] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:05:59.789196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.810326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3a53-8e46-45a7-98f8-2ce15ef87883 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.815317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.816033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.816329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.816608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.817307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.819236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898454-d63b-47b3-90da-0a6b663d04ae admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.821360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.822839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.833928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 777/1560] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:05:59 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:05:59.834705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:05:59.845466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905a9e-8f8d-4418-b387-4a73afc6ecd0 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:05:59.851587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:05:59.852465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.853124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.853124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.853862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:05:59.855763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bc1e9-4896-4740-8326-ca94a04cd320 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:05:59.923746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 784/1561] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:59.928777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.929132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.929565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:05:59.949036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:05:59.951822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:05:59.980084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 778/1562] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:05:59.980084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:05:59.980084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:05:59.980084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.009407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:00.011086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:00.070786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 785/1563] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:00.071786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.150275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 779/1564] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:05:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:00.151734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.170171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a5c0-1be5-49ec-96ff-9563c29b05a9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.178818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.179668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.180074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.180559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.181746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.184363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c2f37-6acf-48ea-8b80-18ef4a1e655a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.187897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109801cd-b730-449a-b62b-3ead4a145926 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.249928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.250778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.251945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.252350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.263204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.264883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.279423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 786/1565] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:00.280299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.298781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 780/1566] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:00 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:00.298781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.298781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.298781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.307212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ddf3-43ab-4e19-9773-c435b90efbb6 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.314390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.315420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.316741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.317284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.319283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.322923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.331298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] MFA Rules not processed for user `891908e1e9c8409ba9e91e341d08825e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:00.333178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:00.412138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 781/1567] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:00.412138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.455916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 787/1568] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:00 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:00.455916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.473026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72701ff7-3e6c-40d5-9d10-d12c9e8f1ebf admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.477318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.478523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.478958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.479533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.496769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.505146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.529628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 788/1569] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:00.530999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.543909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2de77-0ea1-4a6c-97e9-46e3b0a85ddd service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.552124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.553145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.553782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.554373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.555830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.557816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42476-5166-44f6-ab79-e4235ce9be21 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.563627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfca01-f1de-43d3-a663-5a8a7a8e891c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.571371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.572181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.572539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.572875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.574170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 789/1570] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:00.575615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.575900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.576273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.596930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] MFA Rules not processed for user `891908e1e9c8409ba9e91e341d08825e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:00.598594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:00.607036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 790/1571] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:00.607036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.631936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a95816-47c3-4b15-bceb-0a21d018f157 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.637837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.639267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.639660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.640076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.641098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.643592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.656274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 791/1572] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:00.657411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.675551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.677418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68569648-c770-40a1-8bec-ace0576d6788 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.681544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524ce24-bfda-4c14-8f4a-9bfdb8d32932 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.692692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 782/1573] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:00.695905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.696782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.697140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.697491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] PATH_INFO: `/v3/projects/137641ee4a994052b7f6ab91a3f3197a/users/2d699cf7ba97455290385e40e8431f47/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.706721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f9ba-b275-4f8c-afa5-70bd018f7840 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.708876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f9ba-b275-4f8c-afa5-70bd018f7840 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.709382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4f9ba-b275-4f8c-afa5-70bd018f7840 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.711340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 783/1574] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 02:06:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:00.722163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f9ba-b275-4f8c-afa5-70bd018f7840 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.737915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137641ee4a994052b7f6ab91a3f3197a, user_id=2d699cf7ba97455290385e40e8431f47, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.741361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a9e9b-a4e6-4260-9d55-b73facfbff72 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.759382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4f9ba-b275-4f8c-afa5-70bd018f7840 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:00.771252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:00.771252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.771252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.771252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] PATH_INFO: `/v3/projects/f37bb4ff918d41b588912b68ecbbd42e/users/115d164040e749d68d7eed725d05c219/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.809953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37bb4ff918d41b588912b68ecbbd42e, user_id=115d164040e749d68d7eed725d05c219, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:00.812695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:00.836860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 792/1575] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:00 2022] PUT /identity/v3/projects/137641ee4a994052b7f6ab91a3f3197a/users/2d699cf7ba97455290385e40e8431f47/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:00.838293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:00.839017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:00.839402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:00.864562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:00.866447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:00.941652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 784/1576] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:00 2022] PUT /identity/v3/projects/f37bb4ff918d41b588912b68ecbbd42e/users/115d164040e749d68d7eed725d05c219/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:00.943108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:00.970997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 793/1577] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 02:06:00 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:00.972270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.046216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1639577-0522-4f7e-9203-ffd9e722577d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.062251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.063041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.063858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.064162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.065027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.068778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.069966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be9a70-4962-4656-9d45-c6440611a2b0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.077851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.079791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.080078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.080439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.081345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.084220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.100389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 785/1578] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:01.103851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 794/1579] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:01.114310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.114675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.124357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440dfe7-aaf0-47af-91f3-660cccf68ef8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.143534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.146632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.146632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.146632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] PATH_INFO: `/v3/projects/137641ee4a994052b7f6ab91a3f3197a/users/2d699cf7ba97455290385e40e8431f47/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.148220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137641ee4a994052b7f6ab91a3f3197a, user_id=2d699cf7ba97455290385e40e8431f47, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.155304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.180045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 795/1580] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:01 2022] PUT /identity/v3/projects/137641ee4a994052b7f6ab91a3f3197a/users/2d699cf7ba97455290385e40e8431f47/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:01.180045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.220979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d160-35ed-4882-8a2e-464f32677541 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.288451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.289527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd0eb-73d1-4dc5-9596-c5a50ef174b6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.290424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.290424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.290424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.296865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.299356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.299847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.300394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] PATH_INFO: `/v3/projects/f37bb4ff918d41b588912b68ecbbd42e/users/115d164040e749d68d7eed725d05c219/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.304000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37bb4ff918d41b588912b68ecbbd42e, user_id=115d164040e749d68d7eed725d05c219, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.309515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d0b8-4497-4580-b29b-8125835adf19 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.331008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 796/1581] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:01 2022] PUT /identity/v3/projects/f37bb4ff918d41b588912b68ecbbd42e/users/115d164040e749d68d7eed725d05c219/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:01.332998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.333499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.333984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.353530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.355126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afa47e-31eb-4ea4-b64e-ea8d9494abb3 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.375311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 786/1582] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:01.377414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fce-2aa7-4bf3-a568-d5b126cc3645 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.377864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fce-2aa7-4bf3-a568-d5b126cc3645 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.378026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664fce-2aa7-4bf3-a568-d5b126cc3645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.432173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] MFA Rules not processed for user `2d699cf7ba97455290385e40e8431f47`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:01.433404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:01.451202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a6664fce-2aa7-4bf3-a568-d5b126cc3645 None None] MFA Rules not processed for user `115d164040e749d68d7eed725d05c219`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:01.451202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a6664fce-2aa7-4bf3-a568-d5b126cc3645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:01.527055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 797/1583] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:01 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:01.546469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.586031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 787/1584] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:01 2022] POST /identity/v3/auth/tokens => generated 3468 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:01.675151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3059-94a1-4848-ad15-c02ded91e73b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.679509 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.680792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.681399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.681788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.709901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.710439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14569ce5-1bee-461a-aac3-150cce89ff02 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:01.744438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 798/1585] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:01.776474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fac63-2d46-43a6-b51d-8240246cde1b None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.776761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fac63-2d46-43a6-b51d-8240246cde1b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.777037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fac63-2d46-43a6-b51d-8240246cde1b None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.779316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 788/1586] 10.222.0.79 () {54 vars in 912 bytes} [Fri Jan 28 02:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:01.786949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.787422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.787716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.822408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:01.823728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:01.896098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fac63-2d46-43a6-b51d-8240246cde1b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.913578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fac63-2d46-43a6-b51d-8240246cde1b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:01.920262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 799/1587] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:06:01 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:01.924138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:01.924976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:01.925567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:01.932654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:01.944563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:01.944563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:01.948948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:01.954670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13713641-bc4e-4bbf-b401-1e8419cd6fb0 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:02.003094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 789/1588] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3468 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:02.070233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39473768-23c2-4c93-b2ce-b5f706f64673 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:02.082647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:02.084001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:02.112594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:02.112594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:02.120064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:02.120064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3795f-0865-47b9-84d2-dd051c48df76 service glance] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:02.158202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 800/1589] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:02.725595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7361d-52ee-47c7-9e39-6dd67d46a2a6 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:02.725595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7361d-52ee-47c7-9e39-6dd67d46a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:02.725595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7361d-52ee-47c7-9e39-6dd67d46a2a6 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:02.725595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 790/1590] 10.222.0.79 () {54 vars in 912 bytes} [Fri Jan 28 02:06:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:02.726721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:02.726721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:02.726721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:02.766170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:02.768080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:02.817809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7361d-52ee-47c7-9e39-6dd67d46a2a6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:02.840044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7361d-52ee-47c7-9e39-6dd67d46a2a6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:02.858888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:02.861119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:02.861119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:02.865182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:02.960006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 801/1591] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:06:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:02.996296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:02.996296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b49c0-f6c2-42ea-9ce7-899200baa467 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:02.996296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 791/1592] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:02 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:03.077956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.109069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5c637-7b99-44d6-b4e2-e66429456097 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.127431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.128477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.128965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.129181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.132087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.132393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.133508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.166807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.179713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.221994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 802/1593] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:03.225615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] MFA Rules not processed for user `3402e3b89ec6416ca95650d3bacc6a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:03.227187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:03.337658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 792/1594] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/auth/tokens => generated 3423 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:03.346163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.464975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cb131-4b8d-4fba-a03a-d5148bdb5c08 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.472096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.473127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.473607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.474079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.475042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.477618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.625163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.625412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 803/1595] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/projects => generated 401 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:03.732635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640047d-0a84-4bb3-9cb4-6f9d40198831 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.886241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.887209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.887593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.887997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.888947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.891846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:03.903879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:03.931005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900d30a-7479-4b1a-b168-e6f4c80cba62 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:03.945971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:03.947832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:03.948157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:03.948610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] PATH_INFO: `/v3/users/fd67fdb537ad4c3aba6fdfd5a1590643` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:03.950243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd67fdb537ad4c3aba6fdfd5a1590643)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:03.951281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: WARNING py.warnings [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:03.951281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: warnings.warn(msg) Jan 28 02:06:03.951281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: Jan 28 02:06:03.956193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.012562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 793/1596] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:03 2022] POST /identity/v3/users => generated 307 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:04.018461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.043796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a5c5c-b09c-4772-8e13-081c9201c0c2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.062115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.065151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.065844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.066750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.068667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.072218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.098468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 794/1597] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:04.113308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.178651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614be4f-5663-40a3-925b-93439411742a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.203999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.206215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.206511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.206793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] PATH_INFO: `/v3/projects/a4581653565a42e09f26238f52f8f241/users/9927f687700a46fc940320b48a699c15/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.254404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4581653565a42e09f26238f52f8f241, user_id=9927f687700a46fc940320b48a699c15, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.262857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.274063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd67fdb537ad4c3aba6fdfd5a1590643'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:04.277177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd67fdb537ad4c3aba6fdfd5a1590643'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:04.319052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd67fdb537ad4c3aba6fdfd5a1590643'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:04.340670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 795/1598] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:04 2022] PUT /identity/v3/projects/a4581653565a42e09f26238f52f8f241/users/9927f687700a46fc940320b48a699c15/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:04.345660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.423951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd67fdb537ad4c3aba6fdfd5a1590643'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:04.478548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c8e4b77-1bf7-4160-b1da-d276dfd05550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd67fdb537ad4c3aba6fdfd5a1590643'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:04.485086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a495b-7d79-4478-9af9-228a80f26788 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.489072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 804/1599] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:03 2022] DELETE /identity/v3/users/fd67fdb537ad4c3aba6fdfd5a1590643 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:04.493929 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d796-a760-4bab-8cc3-f3aceaf38061 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.497839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.498389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.498500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d796-a760-4bab-8cc3-f3aceaf38061 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.498682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.498917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d796-a760-4bab-8cc3-f3aceaf38061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.499036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.499933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.502624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.538564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 796/1600] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:04.539815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.546034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.561850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b6a2d796-a760-4bab-8cc3-f3aceaf38061 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:04.561850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b6a2d796-a760-4bab-8cc3-f3aceaf38061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.601200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec2bed-4c06-439b-b439-da1623126e5e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.734267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 805/1601] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:04.736670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c6af-75bd-42a1-a2e0-dde9fabd67bc None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.736970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c6af-75bd-42a1-a2e0-dde9fabd67bc None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.737313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121c6af-75bd-42a1-a2e0-dde9fabd67bc None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.739880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 806/1602] 10.222.0.79 () {54 vars in 960 bytes} [Fri Jan 28 02:06:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:04.746581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.748729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.749201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.749694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.753132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.754346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.755234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] PATH_INFO: `/v3/projects/a4581653565a42e09f26238f52f8f241/users/9927f687700a46fc940320b48a699c15/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:04.761124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4581653565a42e09f26238f52f8f241, user_id=9927f687700a46fc940320b48a699c15, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:04.768662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:04.795207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] MFA Rules not processed for user `37e4ba18870847e8bf97f9ed25771af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:04.796398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.797635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 797/1603] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:04 2022] PUT /identity/v3/projects/a4581653565a42e09f26238f52f8f241/users/9927f687700a46fc940320b48a699c15/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:04.803431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.808851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:04.975641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 807/1604] 10.222.0.79 () {58 vars in 1057 bytes} [Fri Jan 28 02:06:04 2022] POST /identity/v3/auth/tokens => generated 3451 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:04.981553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857299e1-8c08-4f1d-9f1b-28746df48f0d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:04.987068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:04.987168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:04.987168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:04.987168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:04.987168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:05.011573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027f8be-deeb-4917-b0a1-a4781b4ab2da None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:05.022749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:05.023735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:05.025532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:05.025983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:05.029704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:05.054901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:05.057277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:05.081740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 808/1605] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:05.104534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:05.107207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:05.159647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 798/1606] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:06.766560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:06.768263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:06.784423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28679df-1758-453f-93f0-a4c1af872104 service placement] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:06.790135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:06.796227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:06.796227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:06.796227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] PATH_INFO: `/v3/projects/2baca0724a954f13a9b56ba19c27d747` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:06.796227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2baca0724a954f13a9b56ba19c27d747)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:06.796227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:06.970186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2baca0724a954f13a9b56ba19c27d747', 'request_id': 'req-25b63d42-8994-4e4b-9640-25870b70800c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:06.987451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2baca0724a954f13a9b56ba19c27d747', 'request_id': 'req-25b63d42-8994-4e4b-9640-25870b70800c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.107035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2baca0724a954f13a9b56ba19c27d747', 'request_id': 'req-25b63d42-8994-4e4b-9640-25870b70800c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.123172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] The token cache is being invalidate because project 2baca0724a954f13a9b56ba19c27d747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:07.123466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.136029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b63d42-8994-4e4b-9640-25870b70800c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.136472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 809/1607] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:06 2022] DELETE /identity/v3/projects/2baca0724a954f13a9b56ba19c27d747 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:07.143144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:07.177760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235cecf-fae4-4125-86c6-5290a3c83150 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:07.339682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:07.340618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:07.345422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:07.345422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] PATH_INFO: `/v3/users/2d699cf7ba97455290385e40e8431f47` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:07.345422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d699cf7ba97455290385e40e8431f47)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:07.350080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:07.571545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d699cf7ba97455290385e40e8431f47'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.582323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d699cf7ba97455290385e40e8431f47'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.601019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d699cf7ba97455290385e40e8431f47'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.681715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d699cf7ba97455290385e40e8431f47'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.682801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d699cf7ba97455290385e40e8431f47'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:07.699253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 799/1608] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:07 2022] DELETE /identity/v3/users/2d699cf7ba97455290385e40e8431f47 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:08.944562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5948-672f-4d29-bfc9-38550dfc87ed None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:08.945081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5948-672f-4d29-bfc9-38550dfc87ed None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:08.945309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5948-672f-4d29-bfc9-38550dfc87ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:08.998330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c5ad5948-672f-4d29-bfc9-38550dfc87ed None None] MFA Rules not processed for user `9927f687700a46fc940320b48a699c15`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:09.001139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c5ad5948-672f-4d29-bfc9-38550dfc87ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:09.045481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:09.046922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:09.182882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 810/1609] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:08 2022] POST /identity/v3/auth/tokens => generated 3488 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:09.197169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0ac41-6f8b-4314-9759-74c6a7349c5d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:09.208869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:09.209809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:09.210109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:09.210567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] PATH_INFO: `/v3/projects/137641ee4a994052b7f6ab91a3f3197a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:09.212723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] RBAC: Authorizing `identity:delete_project(project_id=137641ee4a994052b7f6ab91a3f3197a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:09.220494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: WARNING py.warnings [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:09.220494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: warnings.warn(msg) Jan 28 02:06:09.220494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: Jan 28 02:06:09.222552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:09.436481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137641ee4a994052b7f6ab91a3f3197a', 'request_id': 'req-08575307-bfdc-4900-8da5-24e14d6e823d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:09.447375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137641ee4a994052b7f6ab91a3f3197a', 'request_id': 'req-08575307-bfdc-4900-8da5-24e14d6e823d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:09.589360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137641ee4a994052b7f6ab91a3f3197a', 'request_id': 'req-08575307-bfdc-4900-8da5-24e14d6e823d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:09.643049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] The token cache is being invalidate because project 137641ee4a994052b7f6ab91a3f3197a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:09.643424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:09.645795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-08575307-bfdc-4900-8da5-24e14d6e823d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:09.655907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 800/1610] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:09 2022] DELETE /identity/v3/projects/137641ee4a994052b7f6ab91a3f3197a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:09.658431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544676-1242-4276-9980-e0f259d17db4 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:09.658731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544676-1242-4276-9980-e0f259d17db4 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:09.659014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25544676-1242-4276-9980-e0f259d17db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:09.714230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-25544676-1242-4276-9980-e0f259d17db4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:09.714230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-25544676-1242-4276-9980-e0f259d17db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:09.922044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 811/1611] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:09.930420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:09.931065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:09.931617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:09.970564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:09.974867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:10.012304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 801/1612] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:10.014094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25544676-1242-4276-9980-e0f259d17db4 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.030382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25544676-1242-4276-9980-e0f259d17db4 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.041978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.044583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.044911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.046267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.046267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:10.048876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.051073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.104615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.116337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e15ef-8148-48ae-aee5-395ee2831094 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.117084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 812/1613] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:10.135247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.136000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.136475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.143013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.143013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.143013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.306050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 802/1614] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:10 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:10.310508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.326621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e328b-3f83-4276-b73f-b7c4dafc44e7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.424263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.431049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.431477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.431832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.432708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.434953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.581280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.596131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 813/1615] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:10 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:10.604352 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907002-9f50-4265-ac52-29ea9e061df6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.611738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.612853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.613307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.613722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.614877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.617090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.631751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 803/1616] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:10.643594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.664141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3cf7d-a6d0-427e-9227-e8851c8b4a24 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.680446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.681622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.682125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.682673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.691774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.693729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391f937-4a7a-4b90-8179-dc748d21160d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.728223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 814/1617] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:10.734418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:10.746988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2ab1d-ddc3-490a-afee-034c0b4f2da3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:10.756000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:10.757203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.759780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.759780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] PATH_INFO: `/v3/projects/7d91668d61b047b79eeed3c82fe95d9b/users/943d2a894971462d85efba19ea48387e/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.778850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d91668d61b047b79eeed3c82fe95d9b, user_id=943d2a894971462d85efba19ea48387e, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:10.781697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:10.877942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:10.880255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:10.880255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:10.880785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 804/1618] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:10 2022] PUT /identity/v3/projects/7d91668d61b047b79eeed3c82fe95d9b/users/943d2a894971462d85efba19ea48387e/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:10.921368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] MFA Rules not processed for user `943d2a894971462d85efba19ea48387e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:10.922777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:11.154004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 815/1619] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:10 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:11.159708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:11.306725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e286b69-3753-47ef-b613-2da949c0e657 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:11.320285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:11.321098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:11.321564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:11.336176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:11.336176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:11.337210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:11.453917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 805/1620] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:11 2022] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:11.457240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:11.490696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fa49-924c-4440-aaa0-91d3a4537d4e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:11.692095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:11.693985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:11.693985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:11.693985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:11.694260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:11.699300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:11.857161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 816/1621] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:11 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:11.861997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:11.881037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84901450-e945-4abe-a064-3ab416e554f6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:11.901668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:11.902360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:11.902643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:11.902920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:11.903682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:11.905769 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:11.940690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 806/1622] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:11.947329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:11.962354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87830b7-6e62-4b97-b592-a4356d6a5c59 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:11.987747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:11.988778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:11.989145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:11.989522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] PATH_INFO: `/v3/projects/13c677eb555c40caa413aaae69a83b3c/users/3e36acc2af634b3e9e5063e40424b37b/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.024389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c677eb555c40caa413aaae69a83b3c, user_id=3e36acc2af634b3e9e5063e40424b37b, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:12.027731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:12.120076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 817/1623] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:11 2022] PUT /identity/v3/projects/13c677eb555c40caa413aaae69a83b3c/users/3e36acc2af634b3e9e5063e40424b37b/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:12.124520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:12.139849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143c01b-b26b-4fdc-a7d1-68d23edefe6e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:12.286998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:12.288677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:12.289196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:12.289771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.290844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:12.293652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0a613-3a53-461b-8074-32422676f853 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:12.311963 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 807/1624] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:06:12.316341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:12.336714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338000b1-f6cb-4407-bb03-2aafd485234a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:12.343530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:12.345754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:12.346538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:12.347144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] PATH_INFO: `/v3/projects/13c677eb555c40caa413aaae69a83b3c/users/3e36acc2af634b3e9e5063e40424b37b/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.349835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c677eb555c40caa413aaae69a83b3c, user_id=3e36acc2af634b3e9e5063e40424b37b, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:12.353529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:12.369998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 818/1625] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:12 2022] PUT /identity/v3/projects/13c677eb555c40caa413aaae69a83b3c/users/3e36acc2af634b3e9e5063e40424b37b/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b606-1732-49fc-b366-66acb9d16039 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b606-1732-49fc-b366-66acb9d16039 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b606-1732-49fc-b366-66acb9d16039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0e75b606-1732-49fc-b366-66acb9d16039 None None] MFA Rules not processed for user `3e36acc2af634b3e9e5063e40424b37b`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0e75b606-1732-49fc-b366-66acb9d16039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:12.715791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 808/1626] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:12 2022] POST /identity/v3/auth/tokens => generated 3454 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:12.723300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:12.723300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:12.771118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:12.772023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:12.772581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.870892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] MFA Rules not processed for user `8fd7039b8f074a13b2030a2bb7aaff94`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:12.872174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:12.877953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751cf51-4262-4e1b-aec4-06b492d3661c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:12.887648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:12.888678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:12.888989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:12.889217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:12.916037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:12.917528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801af33-b9c1-455e-839c-43d14f5a8981 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:12.944405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 819/1627] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:12 2022] GET /identity/v3/auth/tokens => generated 3454 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:13.048546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 809/1628] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:13.058572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:13.059129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:13.059620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:13.107714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] MFA Rules not processed for user `8fd7039b8f074a13b2030a2bb7aaff94`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:13.150107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:13.163900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 820/1629] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:13.169470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:13.171219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:13.180440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:13.193211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:13.205692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bba8c-cf8d-49ab-9e45-0b4d5a4542b0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:13.224485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:13.228584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:13.229685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:13.229973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:13.378381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:13.380751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f1239-a430-4dcc-85eb-824f1f895d07 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:13.401312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d30e5-a507-4e9e-9525-a9d8bc178caa None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:13.417490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 810/1630] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:13 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:13.436960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:13.438926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:13.440502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:13.442126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:13.454408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:13.457196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b69de9-a388-4b92-af2c-bfdde5fad62d service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:13.477497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 821/1631] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:13 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:13.729358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:13.752396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:13.752396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:13.772805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553fc6-7f0b-43f3-a204-547d1f1eecb2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:13.773103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553fc6-7f0b-43f3-a204-547d1f1eecb2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:13.773340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553fc6-7f0b-43f3-a204-547d1f1eecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:13.799701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:13.803125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:13.844222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-92553fc6-7f0b-43f3-a204-547d1f1eecb2 None None] MFA Rules not processed for user `a6e7ef3a7fd145e5ab8726786ba318bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:13.865374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-92553fc6-7f0b-43f3-a204-547d1f1eecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:13.924946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 811/1632] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:14.049592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 822/1633] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:13 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:14.057928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:14.059636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:14.080485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0523f-8f03-458a-ba75-a29fa1002a4f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:14.117559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:14.128391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:14.128391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:14.128391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:14.131101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:14.132928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3782f-afc2-4d70-8a53-6214d1f7e1d2 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:14.173120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 812/1634] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:14 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:14.351228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:14.353069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:14.354269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:14.357200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 823/1635] 10.222.0.79 () {54 vars in 912 bytes} [Fri Jan 28 02:06:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:14.364656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:14.364946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:14.365227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:14.413772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:14.416459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:14.446460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:14.448851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:14.604316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 813/1636] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:06:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:14.665621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da2592-aa99-4867-b4d5-8525fa954151 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:14.677595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:14.684275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:14.686183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:14.686859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:14.687142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:14.687419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:14.694936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ea626-ad3d-48ea-9612-dd9171b3fb75 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:14.704751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:14.708303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:14.708848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:14.709479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:14.710598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:14.717262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51327e1c-3f2d-44fd-bb47-2a784dc46398 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:14.731087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:14.732592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:14.748479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 824/1637] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:06:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:14.781008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 814/1638] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:15.408607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:15.415082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:15.415082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:15.492755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:15.506986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:15.542207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 825/1639] 10.222.0.95 () {58 vars in 1015 bytes} [Fri Jan 28 02:06:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:15.562592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:15.580038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5536f5-f190-4e09-b374-1c758c95bef1 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:15.594530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:15.602027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:15.602625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:15.603951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:15.630512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:15.633924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7150a3e-6b1e-407c-8d37-b22be0c2cf5f service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:15.659460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 815/1640] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:15.841244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:15.844195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:16.145337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3ca25-d598-4046-b5c3-430203f1fc5e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:16.158634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:16.162540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:16.162973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:16.163498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] PATH_INFO: `/v3/users/97ac8574ea604dcba44a74871f40fc8f` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:16.163649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:16.164120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:16.164555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:16.165720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ac8574ea604dcba44a74871f40fc8f)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:16.179234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:16.205248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] MFA Rules not processed for user `acab2a0c4a0e48909317791a3de85b53`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:16.208631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:16.429049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 816/1641] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:16 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:16.431613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:16.435762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:16.516131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3f50-a207-4ba2-951d-c3d649e7097b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:16.541143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:16.548054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:16.548711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:16.549311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] PATH_INFO: `/v3/users/3402e3b89ec6416ca95650d3bacc6a88` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:16.554197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3402e3b89ec6416ca95650d3bacc6a88)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:16.564074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:16.564883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ac8574ea604dcba44a74871f40fc8f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:16.565845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ac8574ea604dcba44a74871f40fc8f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:16.581364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ac8574ea604dcba44a74871f40fc8f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:16.684266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ac8574ea604dcba44a74871f40fc8f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:16.718255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ac8574ea604dcba44a74871f40fc8f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:16.743754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 826/1642] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:15 2022] DELETE /identity/v3/users/97ac8574ea604dcba44a74871f40fc8f => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:16.744528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:16.758042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:16.933040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502dab1-f006-4b22-80b3-a9d455e881aa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:16.936811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:16.937487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:16.937824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:16.938962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:16.945015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:17.104143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:17.106474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a7251-a630-4602-aa84-9165c3207c27 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:17.149177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 827/1643] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:16 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:17.151567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08769d91-4a83-42aa-820a-97db950a6b5a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:17.152354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08769d91-4a83-42aa-820a-97db950a6b5a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:17.153028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08769d91-4a83-42aa-820a-97db950a6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:17.207844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-08769d91-4a83-42aa-820a-97db950a6b5a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:17.211000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-08769d91-4a83-42aa-820a-97db950a6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:17.310921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3402e3b89ec6416ca95650d3bacc6a88'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:17.322300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3402e3b89ec6416ca95650d3bacc6a88'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:17.339936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3402e3b89ec6416ca95650d3bacc6a88'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:17.461850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3402e3b89ec6416ca95650d3bacc6a88'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:17.463281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3402e3b89ec6416ca95650d3bacc6a88'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:17.486047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 828/1644] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:17.486892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 817/1645] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:16 2022] DELETE /identity/v3/users/3402e3b89ec6416ca95650d3bacc6a88 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:17.491281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:17.493476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:17.497068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:17.565643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] MFA Rules not processed for user `8fd7039b8f074a13b2030a2bb7aaff94`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:17.567889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:17.612730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:17.614194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:17.785743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 829/1646] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:17 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:17.789976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6db92d-24b3-40bc-9b81-8259f5e83dad admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:17.794721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:17.795799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:17.797067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:17.803819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:18.008814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:18.010810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:18.076312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 818/1647] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:19.061901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:19.065309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:19.093174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776b0c-0efd-479d-ad9f-e4688cc3b036 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:19.107473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:19.112257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:19.112257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:19.112257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] PATH_INFO: `/v3/projects/7c900f58243346da8226fb907a41c600` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:19.113519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c900f58243346da8226fb907a41c600)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:19.119393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:19.335139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c900f58243346da8226fb907a41c600', 'request_id': 'req-615caa37-6545-4b9e-b136-284d50e32186'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:19.358526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c900f58243346da8226fb907a41c600', 'request_id': 'req-615caa37-6545-4b9e-b136-284d50e32186'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:19.604161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c900f58243346da8226fb907a41c600', 'request_id': 'req-615caa37-6545-4b9e-b136-284d50e32186'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:19.621177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] The token cache is being invalidate because project 7c900f58243346da8226fb907a41c600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:19.621489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:19.622198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-615caa37-6545-4b9e-b136-284d50e32186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:19.624275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 830/1648] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:19 2022] DELETE /identity/v3/projects/7c900f58243346da8226fb907a41c600 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:19.630049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:19.655500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d1ffe-7ab2-48d4-85b3-11b24745b2b6 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:19.762047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feede-a9a4-4c97-8dd1-e9401089f295 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:19.766070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feede-a9a4-4c97-8dd1-e9401089f295 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:19.766608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81feede-a9a4-4c97-8dd1-e9401089f295 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:19.768650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 831/1649] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:06:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:19.807148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:19.808143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:19.808810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:19.809372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] PATH_INFO: `/v3/users/9927f687700a46fc940320b48a699c15` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:19.811075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9927f687700a46fc940320b48a699c15)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:19.813434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:19.833833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:19.834360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:19.834863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:19.859410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:19.861611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:19.941727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 832/1650] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:06:19 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:19.975799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:19.977915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:20.019390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38f709-08b7-40a6-8cc8-d1575ec123bf None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:20.026005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:20.026808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:20.027165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:20.027572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:20.038325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:20.040441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:20.056437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 833/1651] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:19 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:20.114454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9927f687700a46fc940320b48a699c15'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.142618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:20.151934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:20.158202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9927f687700a46fc940320b48a699c15'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.198348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc806a-ae5f-411c-9c42-d2abc4c3c9da service nova] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:20.205694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9927f687700a46fc940320b48a699c15'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.213352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:20.215665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:20.217172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:20.218968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] PATH_INFO: `/v3/projects/e421df28a0624265819f380d82dfb55a` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:20.222432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e421df28a0624265819f380d82dfb55a)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:20.228102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:20.330498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9927f687700a46fc940320b48a699c15'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.341221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b14cc54a-53b0-4167-a33a-3ed938fda5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9927f687700a46fc940320b48a699c15'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.371736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 819/1652] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:19 2022] DELETE /identity/v3/users/9927f687700a46fc940320b48a699c15 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:20.472370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e421df28a0624265819f380d82dfb55a', 'request_id': 'req-e73a97d8-5970-4699-8179-e16bad929a4d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.483220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e421df28a0624265819f380d82dfb55a', 'request_id': 'req-e73a97d8-5970-4699-8179-e16bad929a4d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.607606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e421df28a0624265819f380d82dfb55a', 'request_id': 'req-e73a97d8-5970-4699-8179-e16bad929a4d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.627578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] The token cache is being invalidate because project e421df28a0624265819f380d82dfb55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:20.628049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.632166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e73a97d8-5970-4699-8179-e16bad929a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:20.667734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 834/1653] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:20 2022] DELETE /identity/v3/projects/e421df28a0624265819f380d82dfb55a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:20.669948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:20.671004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:20.671504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:20.724607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:20.726275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:20.954633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 820/1654] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:21.154640 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 835/1655] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:21.161825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:21.176975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bb55-4faf-443a-b381-be92c77a97ad None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:21.207927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:21.208632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:21.208922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:21.209210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:21.209954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:21.215822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:21.223510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:21.272059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 821/1656] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:21.276927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:21.290422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3fb6d-1705-45ae-ade6-79b2eb4f75f0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:21.307715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:21.309985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:21.309985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:21.309985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:21.309985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:21.326943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:21.667594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 836/1657] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:21 2022] POST /identity/v3/projects => generated 373 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:21.668822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:21.700253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5462701-62c6-47a0-889d-e390662bf65d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:21.759354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:21.761295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:21.906338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:21.907076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:21.907427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:21.907708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:21.908882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:21.913698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:21.922008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43277-54e8-466f-ae23-d7ed776e360e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:21.928902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:21.929789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:21.930071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:21.930515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] PATH_INFO: `/v3/users/155e001483294448bd43569de5053f29` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:21.931753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155e001483294448bd43569de5053f29)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:21.934243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:22.031426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 822/1658] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:21 2022] POST /identity/v3/users => generated 287 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:22.031426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:22.034463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:22.060408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7dcc-ee77-473f-b0f8-8d2b72dd7078 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:22.076839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:22.077743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:22.078028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:22.078465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] PATH_INFO: `/v3/users/943d2a894971462d85efba19ea48387e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:22.082937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] RBAC: Authorizing `identity:delete_user(user_id=943d2a894971462d85efba19ea48387e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:22.088759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:22.185595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155e001483294448bd43569de5053f29'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.187225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155e001483294448bd43569de5053f29'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.201832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155e001483294448bd43569de5053f29'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.299357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155e001483294448bd43569de5053f29'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.324745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155e001483294448bd43569de5053f29'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.341194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 837/1659] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:21 2022] DELETE /identity/v3/users/155e001483294448bd43569de5053f29 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:22.343233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:22.345928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:22.388835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943d2a894971462d85efba19ea48387e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.404523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943d2a894971462d85efba19ea48387e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.435195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943d2a894971462d85efba19ea48387e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.625866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14011ac-c54d-4258-b2bf-9d1942254366 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:22.650633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:22.651933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:22.652327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:22.652795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:22.656234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:22.658133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bd0ed-e436-489c-8bb5-b7e8ec2e4ecb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:22.693338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 838/1660] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:22.701472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad996ef-22b1-4d9b-9be3-1aaef3d12544 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:22.702570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad996ef-22b1-4d9b-9be3-1aaef3d12544 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:22.704706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad996ef-22b1-4d9b-9be3-1aaef3d12544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:22.793324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3ad996ef-22b1-4d9b-9be3-1aaef3d12544 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:22.812444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943d2a894971462d85efba19ea48387e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.813854 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943d2a894971462d85efba19ea48387e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:22.827378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 823/1661] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:22 2022] DELETE /identity/v3/users/943d2a894971462d85efba19ea48387e => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:22.833802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:22.839934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3ad996ef-22b1-4d9b-9be3-1aaef3d12544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:22.847882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.048577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d39c-cafc-42fb-be77-7a5a05e5184f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.054793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.055735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.056445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.056999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.057982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.059812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:23.078179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 824/1662] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:23.079602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:23.081686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.099393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6c64-5e1e-4baf-a376-b2c2fbe9b163 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.105403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.106669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.107166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.107681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] PATH_INFO: `/v3/projects/a4581653565a42e09f26238f52f8f241` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.108881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 839/1663] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:23.110760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4581653565a42e09f26238f52f8f241)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.111190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.111483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.111795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.113970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:23.171817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:23.174024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.207567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 840/1664] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:23.207567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:23.243668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387500-d0c0-4d43-8482-ef7301f442e7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.273519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.274458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.274740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.275014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] PATH_INFO: `/v3/projects/fa6b248a4dd74a6ea82d40f25010f922/users/974e4b299de0441bb10a86b6ece4e285/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.279308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4581653565a42e09f26238f52f8f241', 'request_id': 'req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:23.292334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4581653565a42e09f26238f52f8f241', 'request_id': 'req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:23.311424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6b248a4dd74a6ea82d40f25010f922, user_id=974e4b299de0441bb10a86b6ece4e285, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.315560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:23.388115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4581653565a42e09f26238f52f8f241', 'request_id': 'req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:23.408559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] The token cache is being invalidate because project a4581653565a42e09f26238f52f8f241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:23.409114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:23.410073 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:23.411835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 825/1665] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:23 2022] DELETE /identity/v3/projects/a4581653565a42e09f26238f52f8f241 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:23.420918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:23.423837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.431173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 841/1666] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:23 2022] PUT /identity/v3/projects/fa6b248a4dd74a6ea82d40f25010f922/users/974e4b299de0441bb10a86b6ece4e285/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:23.432716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:23.442944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.632690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dfdb2-ba2d-49f9-98cd-309ea5d0e1a1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.772186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.772186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.772186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.772186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.773885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.774077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b30c-3ce0-4387-b4c9-0cf2cb8ccca7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.774077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.774077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.774077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.774338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.774338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.804016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.805621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0426c1-1f04-464e-9a89-9da1fa4882a4 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:23.825927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.827596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 842/1667] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:23.828461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f2c59-4608-4c4f-8a5b-58497d982754 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:23.829645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798535af-66a3-41ac-847f-595672ccf67e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.829952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798535af-66a3-41ac-847f-595672ccf67e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.830344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798535af-66a3-41ac-847f-595672ccf67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.847466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 826/1668] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:23.850139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.850794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.851350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.879334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-798535af-66a3-41ac-847f-595672ccf67e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:23.880782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-798535af-66a3-41ac-847f-595672ccf67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.898770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] MFA Rules not processed for user `974e4b299de0441bb10a86b6ece4e285`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:23.898919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 843/1669] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:23.907664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.907960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.908267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.913023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.941156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:23.942471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:23.966612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 844/1670] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:23.970815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:23.987456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f9ff9-c95b-4c40-ae7d-73f4b61d522d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:23.994945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:23.995678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:23.996003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:23.996360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:23.997111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:23.997425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:23.999142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:24.040110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 827/1671] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:24.052387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 845/1672] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:06:24.053807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:24.054246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:24.055846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:24.073539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411131c-c555-4d4f-a8f1-110c764ee7e0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:24.080766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:24.081497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:24.081786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:24.082068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:24.082780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:24.088563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28677244-3971-4a15-b974-93a71528ea44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:24.230510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 846/1673] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:24 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:24.231771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:24.233988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:24.234289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:24.269021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65841f51-8e84-423a-9565-ea403fd63fa1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:24.305139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] MFA Rules not processed for user `a6e7ef3a7fd145e5ab8726786ba318bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:24.306290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:24.466546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:24.468749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:24.469857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:24.470338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:24.554958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 847/1674] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:24 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:24.561813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:24.712952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:24.732308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:24.759783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 828/1675] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:24 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:24.841004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3563-c38c-4d04-a7ba-94d0d8d3e6a6 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:24.866475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:24.868435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:24.869315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:24.870366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:24.872903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:24.882936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:25.020280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 848/1676] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:24 2022] POST /identity/v3/users => generated 287 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:25.024758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:25.047090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6720a1-ddf6-46a8-8827-d313acc6a150 service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:25.089944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:25.090977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:25.096532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:25.096835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:25.097620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:25.099255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:25.160414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 829/1677] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:25.234220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:25.271962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356d735-420b-4b12-92b9-f6b248542db2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:25.298413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:25.299175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:25.299584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:25.299752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:25.300571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:25.321110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3de0c-bb16-4c98-b69b-8c170e15e763 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:25.377062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 849/1678] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:25.381489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:25.406616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7e3f9-c873-418f-bd62-fe9bd830cffa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:25.430172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:25.431236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:25.431624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:25.432029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] PATH_INFO: `/v3/projects/969f13984e0246acb3a7876a57fd3b77/users/92a6689fcf95455bb6aff0a428192d98/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:25.480583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969f13984e0246acb3a7876a57fd3b77, user_id=92a6689fcf95455bb6aff0a428192d98, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:25.483411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:25.574171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 830/1679] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:25 2022] PUT /identity/v3/projects/969f13984e0246acb3a7876a57fd3b77/users/92a6689fcf95455bb6aff0a428192d98/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:25.587302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:25.587852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:25.588371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:25.651283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] MFA Rules not processed for user `92a6689fcf95455bb6aff0a428192d98`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:25.653269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:25.819600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:25.824420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:25.942813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 850/1680] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:25 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:25.952480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:25.988076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d460-9c9d-4783-9f74-10cf80972c38 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:25.993268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd771867-ee2a-4518-832b-d9ba31776a51 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:25.995419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:25.998906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:25.999805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:26.001106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] PATH_INFO: `/v3/users/974e4b299de0441bb10a86b6ece4e285` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:26.004050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=974e4b299de0441bb10a86b6ece4e285)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:26.006543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:26.009949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:26.012414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:26.012414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:26.012414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:26.012414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:26.018424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:26.196469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 851/1681] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:25 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:26.197774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:26.217232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:26.386280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2d8d-1fcb-4c25-9a0c-a9bdbfe166a4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:26.406747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:26.409177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:26.409864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:26.410477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] PATH_INFO: `/v3/projects/0bdc88c222864e50a0dad8b7c7f8020a` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:26.416222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdc88c222864e50a0dad8b7c7f8020a)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:26.422129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:26.491466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974e4b299de0441bb10a86b6ece4e285'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.499865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974e4b299de0441bb10a86b6ece4e285'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.527507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974e4b299de0441bb10a86b6ece4e285'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.659346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974e4b299de0441bb10a86b6ece4e285'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.660003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974e4b299de0441bb10a86b6ece4e285'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.669903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 831/1682] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:25 2022] DELETE /identity/v3/users/974e4b299de0441bb10a86b6ece4e285 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:26.669903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:26.674916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdc88c222864e50a0dad8b7c7f8020a', 'request_id': 'req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.677064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:26.685128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdc88c222864e50a0dad8b7c7f8020a', 'request_id': 'req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:26.807027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92faff3-3bd0-4f61-869e-56bbe565eeab admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:26.813007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:26.814308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:26.814971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:26.815843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:26.817562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:26.819677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:26.989887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdc88c222864e50a0dad8b7c7f8020a', 'request_id': 'req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.012314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 832/1683] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:26 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:27.013376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:27.019242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.053096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] The token cache is being invalidate because project 0bdc88c222864e50a0dad8b7c7f8020a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:27.053096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.056571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e56821ea-86bf-4949-b0fd-e4965c1fd5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.064647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 852/1684] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:26 2022] DELETE /identity/v3/projects/0bdc88c222864e50a0dad8b7c7f8020a => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:27.064647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:27.064647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:27.064647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:27.087914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4777-8508-4c49-a8ee-3bfcfebf6276 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:27.106419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:27.107356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:27.107647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:27.107923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] PATH_INFO: `/v3/projects/7d91668d61b047b79eeed3c82fe95d9b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:27.109840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d91668d61b047b79eeed3c82fe95d9b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:27.112997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:27.119244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:27.120306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.155801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 853/1685] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:27 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:27.157326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:27.170486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.217605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b87c7-2761-461b-bc3d-0338837f75f2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:27.231627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:27.231627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:27.231627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:27.231627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:27.231911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:27.233550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:27.261528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 854/1686] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:27.262490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:27.267271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.298182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fcd8b-9a8b-4154-b451-b17f2dd2d878 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:27.304357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:27.305936 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:27.306378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:27.306804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] PATH_INFO: `/v3/users/115d164040e749d68d7eed725d05c219` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:27.308762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=115d164040e749d68d7eed725d05c219)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:27.312144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:27.351891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d91668d61b047b79eeed3c82fe95d9b', 'request_id': 'req-048481a3-b26a-46d8-96db-1231dd73dc7b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.351891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d91668d61b047b79eeed3c82fe95d9b', 'request_id': 'req-048481a3-b26a-46d8-96db-1231dd73dc7b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.519600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d91668d61b047b79eeed3c82fe95d9b', 'request_id': 'req-048481a3-b26a-46d8-96db-1231dd73dc7b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.560880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] The token cache is being invalidate because project 7d91668d61b047b79eeed3c82fe95d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:27.561186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.568458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.574598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 833/1687] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:27 2022] DELETE /identity/v3/projects/7d91668d61b047b79eeed3c82fe95d9b => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:27.576052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:27.586780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.633842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115d164040e749d68d7eed725d05c219'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.636803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115d164040e749d68d7eed725d05c219'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.649451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115d164040e749d68d7eed725d05c219'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.738449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048481a3-b26a-46d8-96db-1231dd73dc7b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:27.744808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:27.746322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:27.746779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:27.747063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:27.749182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:27.754725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115d164040e749d68d7eed725d05c219'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.801795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115d164040e749d68d7eed725d05c219'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:27.846797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 855/1688] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:27 2022] DELETE /identity/v3/users/115d164040e749d68d7eed725d05c219 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:27.846797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:27.846797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:28.004070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:28.008688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:28.015183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407fa58-0625-4394-b0b9-fe7924e61b5f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:28.024277 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 834/1689] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:28.025128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:28.026006 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:28.026896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.027378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.027760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] PATH_INFO: `/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d/users/542bee751fc0410887c9e063427cfeac/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.028213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:28.062931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38524-69c9-4cc1-bb54-3a57b7652edf service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:28.066278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d3a924e0d844de8511c2ef92ccdc1d, user_id=542bee751fc0410887c9e063427cfeac, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:28.069648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:28.083526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:28.085415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.085886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.086734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] PATH_INFO: `/v3/users/3e36acc2af634b3e9e5063e40424b37b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.088721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e36acc2af634b3e9e5063e40424b37b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:28.102092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:28.181225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 856/1690] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:27 2022] PUT /identity/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d/users/542bee751fc0410887c9e063427cfeac/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:28.186528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:28.361923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdf0e1-61d9-4874-948f-8ceef22d0519 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:28.373031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:28.374181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.374747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.375277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.376848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:28.380200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:28.400051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 857/1691] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:06:28.404132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:28.424880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fe0e-a171-4e08-a3cb-dcf7b2b6d003 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:28.439535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:28.444715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.444715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.444715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] PATH_INFO: `/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d/users/542bee751fc0410887c9e063427cfeac/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.444715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d3a924e0d844de8511c2ef92ccdc1d, user_id=542bee751fc0410887c9e063427cfeac, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:28.457863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39b909-1175-47d8-bfcf-3117c2b185a3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:28.463949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e36acc2af634b3e9e5063e40424b37b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:28.474178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e36acc2af634b3e9e5063e40424b37b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:28.482700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 858/1692] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:28 2022] PUT /identity/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d/users/542bee751fc0410887c9e063427cfeac/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:28.489658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e36acc2af634b3e9e5063e40424b37b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:28.494154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf29e-c721-4c9c-9aa9-059f636b2ea8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.494939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf29e-c721-4c9c-9aa9-059f636b2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.495754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bf29e-c721-4c9c-9aa9-059f636b2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.529334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6a7bf29e-c721-4c9c-9aa9-059f636b2ea8 None None] MFA Rules not processed for user `542bee751fc0410887c9e063427cfeac`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:28.530778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6a7bf29e-c721-4c9c-9aa9-059f636b2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:28.571376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e36acc2af634b3e9e5063e40424b37b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:28.572507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e36acc2af634b3e9e5063e40424b37b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:28.594151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 835/1693] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:28 2022] DELETE /identity/v3/users/3e36acc2af634b3e9e5063e40424b37b => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:28.640274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 859/1694] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3460 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:28.667733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:28.670900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:28.777967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81482-666d-42f3-8012-b4737ab23d16 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.778407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81482-666d-42f3-8012-b4737ab23d16 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.778686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81482-666d-42f3-8012-b4737ab23d16 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.786547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 860/1695] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:06:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:28.866910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.866910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.866910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.867473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37837dd3-5067-47a6-93a5-04d218a372ff admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:28.867473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:28.867473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:28.868380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:28.868380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:28.884560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:28.888489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:29.004913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:29.007582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:29.059664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 836/1696] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:28 2022] GET /identity/v3/auth/tokens => generated 3460 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:29.128691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 861/1697] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:06:28 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:06:29.275054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:29.276565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:29.304065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c941a-f08a-490d-b8fa-b38cd5ec91f1 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:29.323824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:29.328028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:29.328641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:29.329134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:29.364846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:29.366970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:29.380636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 837/1698] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:29 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:29.420117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:29.434696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526841-2f39-4082-bb54-ed51da33a8f0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:29.444841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:29.446738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:29.456520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:29.457202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:29.457495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:29.457772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:29.468298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:29.572541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:29.574136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:29.576490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b755b-89fa-4e12-8563-27bf3c9d8af5 service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:29.590111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:29.591327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:29.591327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:29.591538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] PATH_INFO: `/v3/projects/fa6b248a4dd74a6ea82d40f25010f922` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:29.594228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6b248a4dd74a6ea82d40f25010f922)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:29.596648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:29.600618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 862/1699] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:29 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:29.601706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:29.604071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:29.628735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8bc24-323e-47b1-ac2f-a6326948dfa4 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:29.695312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:29.695312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:29.695312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:29.695312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] PATH_INFO: `/v3/projects/f37bb4ff918d41b588912b68ecbbd42e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:29.697178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37bb4ff918d41b588912b68ecbbd42e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:29.697178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:29.888475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6b248a4dd74a6ea82d40f25010f922', 'request_id': 'req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:29.896687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6b248a4dd74a6ea82d40f25010f922', 'request_id': 'req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:29.919254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37bb4ff918d41b588912b68ecbbd42e', 'request_id': 'req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:29.926210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37bb4ff918d41b588912b68ecbbd42e', 'request_id': 'req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.020860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6b248a4dd74a6ea82d40f25010f922', 'request_id': 'req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.034304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] The token cache is being invalidate because project fa6b248a4dd74a6ea82d40f25010f922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:30.034513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.035240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6d6ff6b5-87c2-49df-aef4-a05d964db9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.036837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 838/1700] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:29 2022] DELETE /identity/v3/projects/fa6b248a4dd74a6ea82d40f25010f922 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:30.038075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24b41-6c2c-4da5-89a5-d41eb0d54ba0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.038359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24b41-6c2c-4da5-89a5-d41eb0d54ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.038637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f24b41-6c2c-4da5-89a5-d41eb0d54ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.067569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-34f24b41-6c2c-4da5-89a5-d41eb0d54ba0 None None] MFA Rules not processed for user `acab2a0c4a0e48909317791a3de85b53`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.069280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-34f24b41-6c2c-4da5-89a5-d41eb0d54ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.127480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 839/1701] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.128913 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4e32-5a2a-4111-8fd2-b5c0b18bf55c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.129201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4e32-5a2a-4111-8fd2-b5c0b18bf55c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.129478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4e32-5a2a-4111-8fd2-b5c0b18bf55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.133122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37bb4ff918d41b588912b68ecbbd42e', 'request_id': 'req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.151898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-950b4e32-5a2a-4111-8fd2-b5c0b18bf55c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.153924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-950b4e32-5a2a-4111-8fd2-b5c0b18bf55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.162149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] The token cache is being invalidate because project f37bb4ff918d41b588912b68ecbbd42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:30.162499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.163299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.165602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 863/1702] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:29 2022] DELETE /identity/v3/projects/f37bb4ff918d41b588912b68ecbbd42e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:30.166378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.167672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.234631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 840/1703] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.234631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb52a-f7f0-4eef-b43c-9315d26776df None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.234631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb52a-f7f0-4eef-b43c-9315d26776df None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.234631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb52a-f7f0-4eef-b43c-9315d26776df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.254581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eda59-9fec-4ab7-aa5d-45b8ff7aa487 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.256743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fe1eb52a-f7f0-4eef-b43c-9315d26776df None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.258165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fe1eb52a-f7f0-4eef-b43c-9315d26776df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.259885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.266728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.266728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.266728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] PATH_INFO: `/v3/projects/13c677eb555c40caa413aaae69a83b3c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.266728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c677eb555c40caa413aaae69a83b3c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.266728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.280029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 841/1704] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.280029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cdde-7604-47e8-853c-78985d681249 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.280029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cdde-7604-47e8-853c-78985d681249 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.280029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cdde-7604-47e8-853c-78985d681249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.301548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f4f3cdde-7604-47e8-853c-78985d681249 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.302784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f4f3cdde-7604-47e8-853c-78985d681249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.314703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 842/1705] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.316172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.316466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.316749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.338032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.339606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.349314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 843/1706] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.350117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.361684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715361-ef2f-4087-a409-aa2f67b8be57 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.367115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.367791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.368591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.368996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.369989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:30.370304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.372036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.393758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 844/1707] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:30.394292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.415542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2c74a-27b1-4333-99cb-a956ef49d6ed admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.422586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.424303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.424756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.425258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.426717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:30.427432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.431000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.454522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c677eb555c40caa413aaae69a83b3c', 'request_id': 'req-40de4d80-c12b-44b2-b95f-63cc7691d3d8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.460314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 845/1708] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:30.461291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.461404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c677eb555c40caa413aaae69a83b3c', 'request_id': 'req-40de4d80-c12b-44b2-b95f-63cc7691d3d8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.472915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3a98-4813-41d6-8dba-97fae5ee702b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.541506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.542177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.542458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.542731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.543611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.546805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6b0c-4f8a-4187-927a-848134c92890 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.555034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c677eb555c40caa413aaae69a83b3c', 'request_id': 'req-40de4d80-c12b-44b2-b95f-63cc7691d3d8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.572431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] The token cache is being invalidate because project 13c677eb555c40caa413aaae69a83b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:30.573906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.576355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:30.578357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 864/1709] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:30 2022] DELETE /identity/v3/projects/13c677eb555c40caa413aaae69a83b3c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:30.579583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.581118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.595101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de4d80-c12b-44b2-b95f-63cc7691d3d8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.599912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.600669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.600961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.601238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.601967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.603893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.653644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 846/1710] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:30.656656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.657396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.657912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.694229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:30.697001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.719358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 865/1711] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:30.721561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.723806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:30.785666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 847/1712] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:30.787554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:30.805885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184713e-539e-4ac2-b8c9-bfd930c258a9 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.829689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349493f5-f0b7-45bf-8cf6-ebc7451a159b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:30.836130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.837275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.838369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.838369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.839566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.841693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2152-9750-4485-bab1-dd64a4177bea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:30.896488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:30.897413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:30.897800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:30.898183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:30.898987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:30.901063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.011907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 866/1713] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:31.013693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.014204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.014701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.045426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:31.046656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:31.061893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 867/1714] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:31.063569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.084428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de0c7c-82be-4db3-90d0-b54936970005 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.090265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.091165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.091573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.091928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.092992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.095609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.108050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 848/1715] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:30 2022] POST /identity/v3/users => generated 279 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:31.110763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.123471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2750-cd15-43db-a038-95ce99732f91 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.125015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 868/1716] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:31.126989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.129428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.130192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.130566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.131144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.132055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:31.132441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.134153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.149971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5ac65-9c5f-4a6d-aad7-8dc2a8bfb7a0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.158886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.159800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.160190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.160668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.161693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.163845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.166295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 849/1717] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:31.167783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.181099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ab70f-9e55-4ed2-aef5-4a9747da7007 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.186964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.187348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.187711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.188176 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.188998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.190813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.201135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 869/1718] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:31.201135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.206840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 850/1719] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:31.206840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.220302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d3610-5074-4789-bb06-5a8d0b0b9862 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.221873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a58839-e8b5-403d-bb62-fa0ecbacf1e6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.226715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.227757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.228083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.228364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.228681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.229159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.229476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.229765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.230067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.230850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.231104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.234717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.257409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 851/1720] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:31.257409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.262830 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb2e77-4053-4269-a93e-216830baa79b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.268339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.269335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.269616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.269892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] PATH_INFO: `/v3/projects/28cd877825a548d293e0336794c3d16c/users/1edaeb6d8e07495b901ee1b19e11f4fd/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.286590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28cd877825a548d293e0336794c3d16c, user_id=1edaeb6d8e07495b901ee1b19e11f4fd, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.291321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.356736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 870/1721] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:31.357583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.411464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 852/1722] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:31 2022] PUT /identity/v3/projects/28cd877825a548d293e0336794c3d16c/users/1edaeb6d8e07495b901ee1b19e11f4fd/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:31.424030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.496876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1a26b-d46f-49a2-9bf4-b34eb3f853ef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.528997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e6e6a-6132-4401-b437-54af571e4c55 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.536285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.537243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.537475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.537957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.538737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.541007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206be51-74e7-4b53-ba97-4be3b8440926 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.603854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.605272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.605611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.606029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] PATH_INFO: `/v3/projects/894e7c88bdc64850b579fd6ef86120fb/users/da10b45264ff4fe4bba541eb0257e029/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.622029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894e7c88bdc64850b579fd6ef86120fb, user_id=da10b45264ff4fe4bba541eb0257e029, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.624797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.641734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 853/1723] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:31.643502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded711-57b7-450c-b34d-0cf2b3e257ed None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.645754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded711-57b7-450c-b34d-0cf2b3e257ed None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.645754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded711-57b7-450c-b34d-0cf2b3e257ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.725606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b1ded711-57b7-450c-b34d-0cf2b3e257ed None None] MFA Rules not processed for user `1edaeb6d8e07495b901ee1b19e11f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:31.727005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b1ded711-57b7-450c-b34d-0cf2b3e257ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:31.732035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 871/1724] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:31 2022] PUT /identity/v3/projects/894e7c88bdc64850b579fd6ef86120fb/users/da10b45264ff4fe4bba541eb0257e029/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:31.732544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.818081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 854/1725] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:31.819495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.819943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.820258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.854923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d759e0-401a-4e5c-a5a2-f9becfd09fe8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.861417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.861654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] MFA Rules not processed for user `da10b45264ff4fe4bba541eb0257e029`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:31.862353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.862736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.862962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:31.863200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.864073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.866144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:31.894976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 872/1726] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:31.894976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:31.905458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9537e8-0036-49a1-8280-8cf8fab69a97 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:31.930625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:31.932405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:31.932934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:31.933492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:31.934531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:31.938346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.018214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 855/1727] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/auth/tokens => generated 3377 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:32.018904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.032351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776959c-fc18-491b-9707-1b4a3b71a11a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.039029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.039029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.039029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.039029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.039965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.041437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.055922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 856/1728] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:32.056911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.070347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 873/1729] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:31 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:32.073711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.073829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1a46-1dd3-4115-ba7f-12d30458589e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.158141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c853178-f0a9-4323-8fff-4bbc05e42a24 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.160896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.161954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.162164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.162971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.163373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.165699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.166281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.171059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.171059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.171059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] PATH_INFO: `/v3/projects/2a55093c1f944e62b9330855c21d6fe9/users/5f7c390bb0454b8aa1b7bc4d556da14f/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.196221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a55093c1f944e62b9330855c21d6fe9, user_id=5f7c390bb0454b8aa1b7bc4d556da14f, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.199703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.346519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 874/1730] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:32 2022] PUT /identity/v3/projects/2a55093c1f944e62b9330855c21d6fe9/users/5f7c390bb0454b8aa1b7bc4d556da14f/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:32.348154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.348802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 857/1731] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/projects => generated 357 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:32.354193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.478093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481432d4-bb05-48af-9542-967f8d52bebb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.482760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.483649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.483938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.484349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.485177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.487198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a96a6-24dd-437c-a6e3-6bf4598c8d57 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.497461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c8a7-9e3a-40b7-99d5-0e7301de3dff admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.503392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.504535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.512505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.512505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.512505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.512505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.596446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 858/1732] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:32.599512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.599512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.599512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.635869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 875/1733] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:32.637133 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] MFA Rules not processed for user `5f7c390bb0454b8aa1b7bc4d556da14f`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:32.638268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:32.640373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.650942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c95c2-cd4c-485f-a446-9319d27a16a4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.655722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.656801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.657332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.657621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.658335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.659941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.674102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 876/1734] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:32.674102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.683405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceb70a-44c5-47f0-911a-b44e193230ac admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.689415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.690121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.690407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.690677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.691518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.693324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.705991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 877/1735] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:32.707246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.718162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18cc9-391a-4d8e-8f57-d1e660eca788 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.723540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 859/1736] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:32.723845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.724848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.725069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.725184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.725393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] PATH_INFO: `/v3/projects/615d007798334bcc91c640ed75345812/users/127d8e7a20cf4e59a36ad979302596a2/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.740485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bea74e-ca62-4ea8-80fe-b1a10c8f619f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:32.751460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=615d007798334bcc91c640ed75345812, user_id=127d8e7a20cf4e59a36ad979302596a2, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.752034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:32.752804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:32.753307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:32.753709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] PATH_INFO: `/v3/projects/ccd970a9d1e044e887d697e2f76c95e6/users/aeb927dd661742389727a824eeb2878e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:32.754324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.772676 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd970a9d1e044e887d697e2f76c95e6, user_id=aeb927dd661742389727a824eeb2878e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:32.775571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:32.884330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 878/1737] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:32 2022] PUT /identity/v3/projects/615d007798334bcc91c640ed75345812/users/127d8e7a20cf4e59a36ad979302596a2/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:32.888369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:32.911728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 860/1738] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:32 2022] PUT /identity/v3/projects/ccd970a9d1e044e887d697e2f76c95e6/users/aeb927dd661742389727a824eeb2878e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:32.914823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.055262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c6bec-0b77-4736-a918-dfa4a71c744c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.104456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedc63-a4f0-4e36-8d0d-7dd2112977e3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.112755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.114035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.114391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.114808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.116221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.118129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.135058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 861/1739] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:33.136234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.165192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.165859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.166142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.166417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.167109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.169199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b64ce0-f1b3-4f46-a0f6-17508a4ea9f1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.170264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c62c-59e0-4f95-b18c-b510db4a3a4d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.194095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.194986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.195214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.195518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.196780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.197906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.211662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 862/1740] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:33.217237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.233788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a950-24ed-4a15-b8a6-1693358c9887 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.241430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.241725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.242415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.242984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] PATH_INFO: `/v3/projects/615d007798334bcc91c640ed75345812/users/127d8e7a20cf4e59a36ad979302596a2/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.245503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] RBAC: Authorizing `identity:create_grant(project_id=615d007798334bcc91c640ed75345812, user_id=127d8e7a20cf4e59a36ad979302596a2, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.248766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.265585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 863/1741] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:33 2022] PUT /identity/v3/projects/615d007798334bcc91c640ed75345812/users/127d8e7a20cf4e59a36ad979302596a2/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:33.267195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.348378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e310f-9637-4a99-b4e8-01ce045730db admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.357361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.359204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.359493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.361467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] PATH_INFO: `/v3/projects/ccd970a9d1e044e887d697e2f76c95e6/users/aeb927dd661742389727a824eeb2878e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.364908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd970a9d1e044e887d697e2f76c95e6, user_id=aeb927dd661742389727a824eeb2878e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.369616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a02448-8d73-490f-a6a8-d727e8ab374c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.385032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 864/1742] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:33 2022] PUT /identity/v3/projects/ccd970a9d1e044e887d697e2f76c95e6/users/aeb927dd661742389727a824eeb2878e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:33.386207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.386498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.386827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.404031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 879/1743] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:32 2022] POST /identity/v3/projects => generated 389 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:33.409449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.409753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.410037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.416386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] MFA Rules not processed for user `127d8e7a20cf4e59a36ad979302596a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:33.417705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:33.444374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] MFA Rules not processed for user `aeb927dd661742389727a824eeb2878e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:33.445989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:33.512932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 865/1744] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3444 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:33.514257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.592218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 880/1745] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:33 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:33.592218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.599958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:33.636175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661227-746b-4074-ad38-ff48e36d3536 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.641818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.642789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.643077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.643362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.646723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.648697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.681290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43106b8f-2583-4235-bcd9-c2d39fb6c155 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.686009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.686939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.687843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.688713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.713159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.716861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.735286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 881/1746] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:33 2022] GET /identity/v3/auth/tokens => generated 3444 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:33.736742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.738573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:33.752897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a8a7f-353d-4ddb-a5c3-c13ff833dc4e service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.756912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.762000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.762000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.762000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.790894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 866/1747] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:33 2022] POST /identity/v3/users => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:33.795102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.818453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff583b74-5379-4596-bcf0-1c5094a7284b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.824125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.825179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.825660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.826124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.827042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.831057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.834438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.836147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:33.850706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 882/1748] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:33 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:33.872786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 867/1749] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:33.881473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:33.904121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc923-a608-41ba-8987-291eab3145a2 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:33.912113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:33.913961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:33.913961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:33.913961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] PATH_INFO: `/v3/projects/6ae8082b3bc34f979d9201262b3b09a8/users/cdb32629a211423c86dfe911afc1c366/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:33.933859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae8082b3bc34f979d9201262b3b09a8, user_id=cdb32629a211423c86dfe911afc1c366, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:33.937141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:34.033283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 883/1750] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:33 2022] PUT /identity/v3/projects/6ae8082b3bc34f979d9201262b3b09a8/users/cdb32629a211423c86dfe911afc1c366/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:34.037562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:34.051532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c156d8-ad80-4c2d-9bb0-167711ac7723 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:34.196328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:34.197020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:34.197302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:34.197679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:34.198365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:34.200668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511358d-5fc3-4a22-8334-22e5513d5868 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:34.218690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 868/1751] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:06:34.220364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:34.233514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8039e-c3f2-4e25-b061-de58c95b14c4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:34.242261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:34.245610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:34.245610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:34.245610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] PATH_INFO: `/v3/projects/6ae8082b3bc34f979d9201262b3b09a8/users/cdb32629a211423c86dfe911afc1c366/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:34.246041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae8082b3bc34f979d9201262b3b09a8, user_id=cdb32629a211423c86dfe911afc1c366, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:34.250185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:34.263204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 884/1752] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:34 2022] PUT /identity/v3/projects/6ae8082b3bc34f979d9201262b3b09a8/users/cdb32629a211423c86dfe911afc1c366/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:34.274377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:34.285975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:34.285975 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:34.324233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] MFA Rules not processed for user `cdb32629a211423c86dfe911afc1c366`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:34.324233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:34.426665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 869/1753] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:34 2022] POST /identity/v3/auth/tokens => generated 3476 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:34.725960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:34.832114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0e1b-490a-47e3-90f0-cb5360f309e5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:34.841149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:34.844784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:34.844784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:34.844784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:34.877044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:34.884677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:34.886306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:34.889559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d36da2-ad1f-4db3-ad91-f9a58c2c74c1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:34.900343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:34.901986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:34.904045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:34.904045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:34.911167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 885/1754] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:34 2022] GET /identity/v3/auth/tokens => generated 3476 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:35.042406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:35.044032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbfa7f-f8c9-42d6-a61e-81c0087ca0f4 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:35.055106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 870/1755] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:34 2022] GET /identity/v3/auth/tokens => generated 3377 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:06:35.220990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:35.300863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b805-326a-450d-95f3-f2b49219538f service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:35.305407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:35.306284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:35.306700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:35.307012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] PATH_INFO: `/v3/users/5f7c390bb0454b8aa1b7bc4d556da14f` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:35.308270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7c390bb0454b8aa1b7bc4d556da14f)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:35.310313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:35.656347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7c390bb0454b8aa1b7bc4d556da14f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:35.656347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7c390bb0454b8aa1b7bc4d556da14f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:35.660421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7c390bb0454b8aa1b7bc4d556da14f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:35.769041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7c390bb0454b8aa1b7bc4d556da14f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:35.781160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7c390bb0454b8aa1b7bc4d556da14f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:35.788300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 886/1756] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:35 2022] DELETE /identity/v3/users/5f7c390bb0454b8aa1b7bc4d556da14f => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:35.793349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:35.793643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:35.793922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:35.811919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:35.813497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:35.879650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 871/1757] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:35 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:35.887818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:35.889581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:35.947326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a08b-dc6c-40c3-8eba-bf9ae77f3f05 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:35.951036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:35.951686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:35.951965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:35.952269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:35.962653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:35.964159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:35.975356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 887/1758] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:35 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:36.465254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:36.466691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:36.479287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888dcf7-cbd7-4735-bdd7-b7d05c028501 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:36.484121 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:36.485284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:36.485594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:36.485869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] PATH_INFO: `/v3/projects/2a55093c1f944e62b9330855c21d6fe9` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:36.487594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a55093c1f944e62b9330855c21d6fe9)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:36.489553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:36.583399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a55093c1f944e62b9330855c21d6fe9', 'request_id': 'req-dd5bd890-c19a-478e-a2ee-531c2fcd2390'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.588545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a55093c1f944e62b9330855c21d6fe9', 'request_id': 'req-dd5bd890-c19a-478e-a2ee-531c2fcd2390'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.654841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a55093c1f944e62b9330855c21d6fe9', 'request_id': 'req-dd5bd890-c19a-478e-a2ee-531c2fcd2390'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.668349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] The token cache is being invalidate because project 2a55093c1f944e62b9330855c21d6fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:36.668846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.669727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.671585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 872/1759] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:36 2022] DELETE /identity/v3/projects/2a55093c1f944e62b9330855c21d6fe9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:36.677604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:36.690128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd7c01-587a-4eee-9c73-22de878a698c service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:36.753400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:36.754192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:36.754474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:36.754859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] PATH_INFO: `/v3/users/cdb32629a211423c86dfe911afc1c366` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:36.755987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb32629a211423c86dfe911afc1c366)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:36.757962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:36.967990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb32629a211423c86dfe911afc1c366'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.968661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb32629a211423c86dfe911afc1c366'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:36.975532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb32629a211423c86dfe911afc1c366'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.074697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb32629a211423c86dfe911afc1c366'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.088272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37897bb6-5bf9-46b5-b93b-7348998c5e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb32629a211423c86dfe911afc1c366'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.095540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 888/1760] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:36 2022] DELETE /identity/v3/users/cdb32629a211423c86dfe911afc1c366 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:37.556589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:37.558051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:37.571594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd890-c19a-478e-a2ee-531c2fcd2390 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:37.628548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:37.629392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:37.629670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:37.629947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] PATH_INFO: `/v3/projects/6ae8082b3bc34f979d9201262b3b09a8` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:37.631103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae8082b3bc34f979d9201262b3b09a8)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:37.633060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:37.749278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae8082b3bc34f979d9201262b3b09a8', 'request_id': 'req-5935e887-a467-4572-a786-5f172d19b989'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.778502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae8082b3bc34f979d9201262b3b09a8', 'request_id': 'req-5935e887-a467-4572-a786-5f172d19b989'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.877679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae8082b3bc34f979d9201262b3b09a8', 'request_id': 'req-5935e887-a467-4572-a786-5f172d19b989'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.892178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] The token cache is being invalidate because project 6ae8082b3bc34f979d9201262b3b09a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:06:37.892617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.893516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-5935e887-a467-4572-a786-5f172d19b989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:37.895434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 873/1761] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:06:37 2022] DELETE /identity/v3/projects/6ae8082b3bc34f979d9201262b3b09a8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:37.900944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:37.901305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:37.901783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:37.924684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:37.925925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:37.992126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 889/1762] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:38.001235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.001630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.001832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.032694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:38.033731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:38.059172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 874/1763] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:37 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:38.064080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.080066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83861472-d3d9-448b-a8ba-a233a231d03e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.087050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.087899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.088316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.088964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.090037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:06:38.090530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.092466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.120629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 890/1764] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:06:38.124766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.136439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b5a58-6fd2-4c55-b412-dd6286d526c8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.149518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.150365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.150832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.151238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.152138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.154368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.270210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 875/1765] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:38 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:38.274263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.286107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d7828-0c60-413f-a416-bab5ba736404 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.362522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.363228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.363518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.363799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.364540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.366935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.462579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 891/1766] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:38 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:38.465340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.486300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9cbf-3d21-4c20-9e4d-5e2ccc3c3478 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.495921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.497887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.499641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.499948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.501307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.502967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.523190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 876/1767] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:38.524216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.535490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec7fd-8aee-47b8-aee6-d5d5b2633da5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.540467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.541130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.541411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.541685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.542694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.544108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349ec93-31ac-4731-a5d2-f25acccca993 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.558520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 892/1768] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:06:38.561604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.573416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940815-588c-4e37-9ad6-626a6097f34b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.579802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.581437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.581902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.582187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] PATH_INFO: `/v3/projects/5d00b485cdc044af82525e32aa02dcf1/users/e15966df04324682acba9453f5511805/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.600903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d00b485cdc044af82525e32aa02dcf1, user_id=e15966df04324682acba9453f5511805, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.603686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:38.664839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 877/1769] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:38 2022] PUT /identity/v3/projects/5d00b485cdc044af82525e32aa02dcf1/users/e15966df04324682acba9453f5511805/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:38.677409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.677730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.678011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.736692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] MFA Rules not processed for user `e15966df04324682acba9453f5511805`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:38.738060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:38.828876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 893/1770] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:38 2022] POST /identity/v3/auth/tokens => generated 3429 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:38.833540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:38.919441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c886e-08a1-4c7b-a762-fa5b34d41cec admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:38.924931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:38.925630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:38.925924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:38.926194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:38.926908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:38.937404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.020789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 878/1771] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:06:38 2022] POST /identity/v3/projects => generated 409 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:06:39.024772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.036641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6928b-9b4c-4964-883c-8eae8f050351 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.136215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.137154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.137429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.138155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.138871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.143165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.294024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 894/1772] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:06:39 2022] POST /identity/v3/users => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:06:39.294815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.306285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e8c00-2ff7-4ce9-a55a-dc567b4d800e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.311942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.313130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.313545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.313819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.314568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.316195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.327885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 879/1773] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:39.332511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.343513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95786b-c998-4b0f-94a6-87f86a5d6707 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.350211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.351340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.351776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.352226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] PATH_INFO: `/v3/projects/1c598420f6f3433f80d048c91837252c/users/ebb24ed9606f4588b1ad066072044559/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.371839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c598420f6f3433f80d048c91837252c, user_id=ebb24ed9606f4588b1ad066072044559, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.375362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.468409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 895/1774] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:39 2022] PUT /identity/v3/projects/1c598420f6f3433f80d048c91837252c/users/ebb24ed9606f4588b1ad066072044559/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:39.473888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.480875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b2d5-f3bd-4ff9-a560-ed57b14a288a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.539486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.540084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.540366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.540634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.541355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.543021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed61e68-6cfc-46cc-b9f6-16268f2afc9c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.557945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 880/1775] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:06:39.562190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.582764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda68161-9ba3-4900-a0fd-27df4b85dc42 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.589122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.590649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.590649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.590913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] PATH_INFO: `/v3/projects/1c598420f6f3433f80d048c91837252c/users/ebb24ed9606f4588b1ad066072044559/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.593266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c598420f6f3433f80d048c91837252c, user_id=ebb24ed9606f4588b1ad066072044559, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.596768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.608615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 896/1776] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:06:39 2022] PUT /identity/v3/projects/1c598420f6f3433f80d048c91837252c/users/ebb24ed9606f4588b1ad066072044559/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:06:39.621392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cd49-5f64-48cf-bfa4-fa5780643906 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.622656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cd49-5f64-48cf-bfa4-fa5780643906 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.622656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cd49-5f64-48cf-bfa4-fa5780643906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.667692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4413cd49-5f64-48cf-bfa4-fa5780643906 None None] MFA Rules not processed for user `ebb24ed9606f4588b1ad066072044559`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:39.669313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4413cd49-5f64-48cf-bfa4-fa5780643906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:39.764429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 881/1777] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:39 2022] POST /identity/v3/auth/tokens => generated 3496 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:39.778739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:39.780743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:39.872903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065a97-c045-4e72-a463-53aab303dd73 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:39.878784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:39.880132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:39.880425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:39.886422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:39.897491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:39.899246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36b4ae-2263-4a92-b376-2c76028057a4 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:39.914868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 897/1778] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:39 2022] GET /identity/v3/auth/tokens => generated 3496 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:40.334670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095867b-b925-49d3-bf1f-00b13fd24a9a None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.335228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095867b-b925-49d3-bf1f-00b13fd24a9a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.335617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095867b-b925-49d3-bf1f-00b13fd24a9a None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.338142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 882/1779] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:06:40.358465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.358465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.359026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.392894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:40.394204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:40.487843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095867b-b925-49d3-bf1f-00b13fd24a9a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.488072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 898/1780] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:06:40 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:40.519631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095867b-b925-49d3-bf1f-00b13fd24a9a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.527012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.527956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.528431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.532258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.541011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:40.543234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:40.573129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99fdb-7a60-4c4e-8088-0597ebec376d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:40.584296 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:40.587084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:40.588111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:40.588482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:40.606594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.608374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:40.622344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 899/1781] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:40 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:40.654425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:40.655921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:40.669206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 883/1782] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:40 2022] GET /identity/v3/auth/tokens => generated 3429 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:43.629095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:43.647100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6c69-df81-493b-99ec-84dab52d7984 service nova] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:43.653928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:43.654675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:43.655022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:43.655382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:43.658137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:43.747368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:43.751316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae2d1d-f0ab-4ed6-b57c-4cd09844067c service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:43.767394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 900/1783] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:43 2022] GET /identity/v3/auth/tokens => generated 3462 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:06:59.074709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.150876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b16f39-0d7c-4e5d-bdcf-975f27f2788b service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.156285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.163339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.163339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.163339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] PATH_INFO: `/v3/users/e15966df04324682acba9453f5511805` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.163339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15966df04324682acba9453f5511805)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.163339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.365653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15966df04324682acba9453f5511805'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.372148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15966df04324682acba9453f5511805'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.386268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15966df04324682acba9453f5511805'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.463314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15966df04324682acba9453f5511805'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.463921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15966df04324682acba9453f5511805'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:06:59.470565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 884/1784] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:06:59 2022] DELETE /identity/v3/users/e15966df04324682acba9453f5511805 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:06:59.475321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.475853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.475944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.493376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:06:59.494604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.556575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 901/1785] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:06:59 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:06:59.566667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:06:59.568746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:06:59.640312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4b76-d960-46b2-afd7-d16e75a9db00 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:06:59.645542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:06:59.646799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:06:59.647326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:06:59.647703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:06:59.658591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:06:59.660740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:06:59.674809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 885/1786] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:06:59 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:00.179270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:00.180896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:00.195106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5a9fc-f8f2-4baf-b9a7-c7b1c628a69a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.205307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.205307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.205307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.205307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] PATH_INFO: `/v3/projects/5d00b485cdc044af82525e32aa02dcf1` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.205724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d00b485cdc044af82525e32aa02dcf1)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.208290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.353500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d00b485cdc044af82525e32aa02dcf1', 'request_id': 'req-37916cf4-df20-4034-a275-01da6790f9e6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.360294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d00b485cdc044af82525e32aa02dcf1', 'request_id': 'req-37916cf4-df20-4034-a275-01da6790f9e6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.431879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d00b485cdc044af82525e32aa02dcf1', 'request_id': 'req-37916cf4-df20-4034-a275-01da6790f9e6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.444846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] The token cache is being invalidate because project 5d00b485cdc044af82525e32aa02dcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:00.445170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.445814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.447442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 902/1787] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:00 2022] DELETE /identity/v3/projects/5d00b485cdc044af82525e32aa02dcf1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:00.452022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:00.464126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbec6-bec2-4539-9e73-22d36d05407d service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:00.536051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:00.536962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:00.537248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:00.537522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] PATH_INFO: `/v3/users/ebb24ed9606f4588b1ad066072044559` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:00.538774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb24ed9606f4588b1ad066072044559)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:00.540803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:00.769600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb24ed9606f4588b1ad066072044559'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.769600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb24ed9606f4588b1ad066072044559'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.778514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb24ed9606f4588b1ad066072044559'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.860682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb24ed9606f4588b1ad066072044559'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.863423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a5fd8ad6-ac29-4304-b79a-6280b11e025c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb24ed9606f4588b1ad066072044559'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:00.868575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 886/1788] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:00 2022] DELETE /identity/v3/users/ebb24ed9606f4588b1ad066072044559 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:01.482189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.483710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.513294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916cf4-df20-4034-a275-01da6790f9e6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.575451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.576341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.576625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.576901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] PATH_INFO: `/v3/projects/1c598420f6f3433f80d048c91837252c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.578095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c598420f6f3433f80d048c91837252c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.580018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.728227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c598420f6f3433f80d048c91837252c', 'request_id': 'req-72d9e4dd-4182-4781-b965-9fac897ab70a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.735223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c598420f6f3433f80d048c91837252c', 'request_id': 'req-72d9e4dd-4182-4781-b965-9fac897ab70a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.791948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c598420f6f3433f80d048c91837252c', 'request_id': 'req-72d9e4dd-4182-4781-b965-9fac897ab70a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.804246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] The token cache is being invalidate because project 1c598420f6f3433f80d048c91837252c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:01.804556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.805197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-72d9e4dd-4182-4781-b965-9fac897ab70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:01.807252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 903/1789] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:01 2022] DELETE /identity/v3/projects/1c598420f6f3433f80d048c91837252c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:01.813678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.814207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.814328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.833829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:01.835175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.910169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 887/1790] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:01.918534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.918828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.919110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.938533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:01.939744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:01.948435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 904/1791] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:01.952693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.962714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa2fe-cc1f-4158-a6ce-da33340dc2d4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:01.968247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:01.968920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:01.969241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:01.969551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:01.970329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:01.970647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:01.973028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:01.989126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 888/1792] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:01.990355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:01.999914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840cdb2-24c7-4516-b219-1ec6aaf3745d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.004716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.005384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.005671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.005950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.006662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.008613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.122762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 905/1793] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:01 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:02.127051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.139119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3316535-f3e9-4e84-9d3e-13fbbe7edfc6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.198309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.199016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.199301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.199575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.200334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.202485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.307886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 889/1794] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:02 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:02.311172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.322338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae72f-1e58-4e1f-81a5-5aa40798ae09 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.327054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.332171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.332171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.332171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.332171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.332171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.342779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 906/1795] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:02.347530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.357867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c958b-78bf-4518-a091-60afca79c695 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.363547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.363849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.364181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.364457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.365213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.366828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a05eb-d6b3-45bc-b7a1-cdfcb2be0427 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.382355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 890/1796] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:02.383353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.394228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145bc6-b6ca-4fab-9e70-4d96fb2f381b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.399907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.400958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.401243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.401519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] PATH_INFO: `/v3/projects/85d29a889fea44f08438f4c7e8eaee59/users/04bc834e19f049388f6c1910a79169f6/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.418238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d29a889fea44f08438f4c7e8eaee59, user_id=04bc834e19f049388f6c1910a79169f6, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.420960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.524126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 907/1797] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:02 2022] PUT /identity/v3/projects/85d29a889fea44f08438f4c7e8eaee59/users/04bc834e19f049388f6c1910a79169f6/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:02.535091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca59-525f-4593-802d-f40a37449df6 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.538749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca59-525f-4593-802d-f40a37449df6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.538749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eca59-525f-4593-802d-f40a37449df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.564639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-832eca59-525f-4593-802d-f40a37449df6 None None] MFA Rules not processed for user `04bc834e19f049388f6c1910a79169f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:02.566359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-832eca59-525f-4593-802d-f40a37449df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:02.630253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 891/1798] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:02 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:02.634719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.700445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d851449-c113-4375-89e9-31b20fe16609 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.705154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.705817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.706211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.707352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.707763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.709747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.827770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 908/1799] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:02 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:02.831844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eca59-525f-4593-802d-f40a37449df6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.843501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eca59-525f-4593-802d-f40a37449df6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.907838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.908627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.908990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.909203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.910016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.912716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:02.975502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 892/1800] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:02 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:02.979487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:02.990432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f15275-f3fe-439e-982e-2b146b003240 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:02.995009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:02.995655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:02.995937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:02.996247 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:02.996956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:02.998547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.009541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 909/1801] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:03.013699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.023684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8576b-ebe6-454a-8663-0efab4f480e5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.028377 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.029252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.029532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.029803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] PATH_INFO: `/v3/projects/79e0187426cb4beb98fca685ce21efbe/users/b1e277d04cb74ccda9a5a7cf8db73794/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.044325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e0187426cb4beb98fca685ce21efbe, user_id=b1e277d04cb74ccda9a5a7cf8db73794, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.046959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.094997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 893/1802] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:03 2022] PUT /identity/v3/projects/79e0187426cb4beb98fca685ce21efbe/users/b1e277d04cb74ccda9a5a7cf8db73794/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:03.098993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.109192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46203026-aff5-4eea-b577-5897a64d5a5e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.167123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.167865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.172998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.172998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.172998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.172998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea2ab2-32f0-44fc-9c44-8bbd63481e1e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.181553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 910/1803] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:03.185964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.196356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08592b8-e4f2-4442-afd3-3c616a756cb7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.201494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.202369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.202651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.202922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] PATH_INFO: `/v3/projects/79e0187426cb4beb98fca685ce21efbe/users/b1e277d04cb74ccda9a5a7cf8db73794/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.204958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e0187426cb4beb98fca685ce21efbe, user_id=b1e277d04cb74ccda9a5a7cf8db73794, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.207833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.219299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 894/1804] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:03 2022] PUT /identity/v3/projects/79e0187426cb4beb98fca685ce21efbe/users/b1e277d04cb74ccda9a5a7cf8db73794/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:03.230874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.233293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.233293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.260761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] MFA Rules not processed for user `b1e277d04cb74ccda9a5a7cf8db73794`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:03.261973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:03.329773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 911/1805] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:03 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:03.366523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.368279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:03.422615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e7a87-c10a-4ed5-8a76-1639ebd96770 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.427108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.427750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.428067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.428347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.437269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.438685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.454679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 895/1806] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:03 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:03.669116 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:03.678700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66d6f-3a3b-440e-8ce2-3b7386367837 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:03.682547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:03.683201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:03.683501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:03.683761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:03.738922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:03.740398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a8674-08a5-4b1a-aead-111663bccaaa service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:03.750027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 912/1807] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:03 2022] GET /identity/v3/auth/tokens => generated 3385 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:12.514288 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:12.579735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c95a6-3208-466a-9176-418bc0f81bfe service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:12.584453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:12.585368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:12.586095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:12.586095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] PATH_INFO: `/v3/users/04bc834e19f049388f6c1910a79169f6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:12.587079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bc834e19f049388f6c1910a79169f6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:12.589767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:12.785142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bc834e19f049388f6c1910a79169f6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:12.793274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bc834e19f049388f6c1910a79169f6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:12.805764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bc834e19f049388f6c1910a79169f6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:12.897832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bc834e19f049388f6c1910a79169f6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:12.898478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bc834e19f049388f6c1910a79169f6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:12.905291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 896/1808] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:12 2022] DELETE /identity/v3/users/04bc834e19f049388f6c1910a79169f6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:12.910066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:12.910551 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:12.910706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:12.930458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:12.932987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.005381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 913/1809] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:13.019847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:13.019847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.094656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1c7d-848a-467b-aae9-2ba2711b3fc3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:13.096686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:13.097615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:13.097996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:13.099763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:13.113744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:13.115204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:13.128369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 897/1810] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:13.803244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:13.803244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:13.829166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314edb-b4f2-4abb-8b1e-a631e4dee706 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:13.830275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:13.831157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:13.831434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:13.831704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] PATH_INFO: `/v3/projects/85d29a889fea44f08438f4c7e8eaee59` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:13.832906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d29a889fea44f08438f4c7e8eaee59)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:13.834862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:13.966822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d29a889fea44f08438f4c7e8eaee59', 'request_id': 'req-3596e14c-3beb-4f6f-ba6e-233946ab8963'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:13.973029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d29a889fea44f08438f4c7e8eaee59', 'request_id': 'req-3596e14c-3beb-4f6f-ba6e-233946ab8963'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.040523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d29a889fea44f08438f4c7e8eaee59', 'request_id': 'req-3596e14c-3beb-4f6f-ba6e-233946ab8963'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.055121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] The token cache is being invalidate because project 85d29a889fea44f08438f4c7e8eaee59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:14.055421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.056125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.058096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 914/1811] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:13 2022] DELETE /identity/v3/projects/85d29a889fea44f08438f4c7e8eaee59 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:14.062186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:14.073297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b44b-21eb-47af-8ad9-748d9852bcc2 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:14.136721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:14.137825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:14.138273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:14.138715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] PATH_INFO: `/v3/users/b1e277d04cb74ccda9a5a7cf8db73794` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:14.143307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e277d04cb74ccda9a5a7cf8db73794)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:14.146034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:14.368146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e277d04cb74ccda9a5a7cf8db73794'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.375299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e277d04cb74ccda9a5a7cf8db73794'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.390370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e277d04cb74ccda9a5a7cf8db73794'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.456390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e277d04cb74ccda9a5a7cf8db73794'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.457792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e2612d62-5f3a-48fa-90d8-8d16bebc3744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e277d04cb74ccda9a5a7cf8db73794'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:14.470618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 898/1812] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:14 2022] DELETE /identity/v3/users/b1e277d04cb74ccda9a5a7cf8db73794 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:14.969052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:14.970565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:14.984877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596e14c-3beb-4f6f-ba6e-233946ab8963 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.050188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.051079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.053349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.053349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] PATH_INFO: `/v3/projects/79e0187426cb4beb98fca685ce21efbe` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.053718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e0187426cb4beb98fca685ce21efbe)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.055623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.201262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e0187426cb4beb98fca685ce21efbe', 'request_id': 'req-7271e0e2-7e82-4874-9cee-27334aa0f188'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.207411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e0187426cb4beb98fca685ce21efbe', 'request_id': 'req-7271e0e2-7e82-4874-9cee-27334aa0f188'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.274677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e0187426cb4beb98fca685ce21efbe', 'request_id': 'req-7271e0e2-7e82-4874-9cee-27334aa0f188'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.285915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] The token cache is being invalidate because project 79e0187426cb4beb98fca685ce21efbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:15.286211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.286865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7271e0e2-7e82-4874-9cee-27334aa0f188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.288524 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 915/1813] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:14 2022] DELETE /identity/v3/projects/79e0187426cb4beb98fca685ce21efbe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:15.294590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.295085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.295175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.313688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:15.315078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:15.387380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 899/1814] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:15.391701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.392005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.392290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.411781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:15.413004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:15.421686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 916/1815] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:15.426231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.437047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d3f0c-004f-4a1a-8cb9-60cd4078ee86 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.442512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.443240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.443522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.443798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.444659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:15.444934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.446542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.459230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 900/1816] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:15.464219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.474231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c491ae-bf9d-4b7d-8320-343d2855d75a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.479433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.480123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.480411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.480724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.481425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.483592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.611373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 917/1817] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:15 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:15.612909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.625940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba63230-101c-4a43-9716-c5c1a8ae3005 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.696755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.696755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.696755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.696755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.697113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.697762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.697924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.698053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:15.709906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fec31-4606-4346-a612-15f157483c59 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.716991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.717872 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.718155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.718434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] PATH_INFO: `/v3/users/1edaeb6d8e07495b901ee1b19e11f4fd` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.719701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edaeb6d8e07495b901ee1b19e11f4fd)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.721717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.782181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 901/1818] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:15 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:15.783486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.793147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f632e-530f-46ea-9ce0-08fc2150d515 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.797796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.798427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.798707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.798979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.799744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.801353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.812029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 902/1819] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:15.815781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.831504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb59205-7797-4443-ab01-a35c234e5a44 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.831650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.832267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.832546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.832821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.833531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.835092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.846567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 903/1820] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:15.854026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:15.860827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bc5-2bf7-41fb-902e-13f820fc2ad9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:15.865460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:15.866326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.866609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.866918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] PATH_INFO: `/v3/projects/a366c48c3423449ba15709777e5868cb/users/913263abe3d8426bb44daa9b6f80ba0a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.883551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a366c48c3423449ba15709777e5868cb, user_id=913263abe3d8426bb44daa9b6f80ba0a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:15.886943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ea3dd-3ce5-4a66-8740-c12ebc210f2d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:15.920236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edaeb6d8e07495b901ee1b19e11f4fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.920922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edaeb6d8e07495b901ee1b19e11f4fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.927780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edaeb6d8e07495b901ee1b19e11f4fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.947481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 904/1821] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:15 2022] PUT /identity/v3/projects/a366c48c3423449ba15709777e5868cb/users/913263abe3d8426bb44daa9b6f80ba0a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:15.959314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:15.959611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:15.959894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:15.986440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edaeb6d8e07495b901ee1b19e11f4fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:15.987019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] MFA Rules not processed for user `913263abe3d8426bb44daa9b6f80ba0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:15.988038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.000005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-67b2e850-b857-44a9-aacc-6efb8cb5f14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edaeb6d8e07495b901ee1b19e11f4fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.006098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 918/1822] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:15 2022] DELETE /identity/v3/users/1edaeb6d8e07495b901ee1b19e11f4fd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:16.011357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.011736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.012052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.028945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:16.030259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.052678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 905/1823] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:15 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:16.064261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:16.065713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.089274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 919/1824] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:16.106480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:16.108091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.120945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05027073-50fa-4a1e-a2ed-41c6e76aead3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:16.169910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754842d4-1e61-4b3e-95ba-d59c2b898bc1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:16.174385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:16.175497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.175907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.176452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.187914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:16.189123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:16.192814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:16.193188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.193188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.193188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.199937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 920/1825] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:16.250491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:16.251965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:16.262046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 906/1826] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:16 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:16.650717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:16.652411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.667700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931de7d-437e-4e23-84e9-a4e805f0fbea service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:16.673626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:16.674529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.674904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.675066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] PATH_INFO: `/v3/projects/28cd877825a548d293e0336794c3d16c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.676274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28cd877825a548d293e0336794c3d16c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:16.678248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:16.816500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28cd877825a548d293e0336794c3d16c', 'request_id': 'req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.824374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28cd877825a548d293e0336794c3d16c', 'request_id': 'req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.843214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:16.844677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.859234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc42f6d-5265-4e72-8f9a-515eaa44ed25 service glance] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:16.921970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:16.922946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.923229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.923500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] PATH_INFO: `/v3/users/da10b45264ff4fe4bba541eb0257e029` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.924731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da10b45264ff4fe4bba541eb0257e029)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:16.926675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:16.928953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28cd877825a548d293e0336794c3d16c', 'request_id': 'req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.941297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] The token cache is being invalidate because project 28cd877825a548d293e0336794c3d16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:16.941594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.942258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:16.943807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 921/1827] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:16 2022] DELETE /identity/v3/projects/28cd877825a548d293e0336794c3d16c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:16.947915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:16.949346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:16.962168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c27e5-5e62-436e-aaf0-7ae10cebcbd3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:16.967540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:16.968463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:16.968769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:16.969050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] PATH_INFO: `/v3/users/aeb927dd661742389727a824eeb2878e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:16.970255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb927dd661742389727a824eeb2878e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:16.972224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:17.116891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da10b45264ff4fe4bba541eb0257e029'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.127356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da10b45264ff4fe4bba541eb0257e029'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.137290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da10b45264ff4fe4bba541eb0257e029'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.212766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb927dd661742389727a824eeb2878e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.213871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb927dd661742389727a824eeb2878e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.215390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da10b45264ff4fe4bba541eb0257e029'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.219412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f1a1128-59a4-4590-9ccc-7212c362590a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da10b45264ff4fe4bba541eb0257e029'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.221631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb927dd661742389727a824eeb2878e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.223463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 907/1828] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:16 2022] DELETE /identity/v3/users/da10b45264ff4fe4bba541eb0257e029 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:17.228215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:17.228215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:17.228215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:17.245998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:17.247189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:17.283405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb927dd661742389727a824eeb2878e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.300712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb927dd661742389727a824eeb2878e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.311441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 908/1829] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:17.314549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 922/1830] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:16 2022] DELETE /identity/v3/users/aeb927dd661742389727a824eeb2878e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:17.321899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:17.323502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:17.385013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38eb25-7d29-42e1-8546-3fb84fbe53da None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:17.440096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:17.440743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:17.441028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:17.441304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:17.501766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:17.503185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb15fc-67f3-4d8a-b1c7-00e3ac44e7b4 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:17.513611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 909/1831] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:17.767812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:17.771888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:17.791860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea79911-8898-4fad-8b14-999617d71b38 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:17.797792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:17.798122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:17.798407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:17.798953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] PATH_INFO: `/v3/projects/ccd970a9d1e044e887d697e2f76c95e6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:17.800497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd970a9d1e044e887d697e2f76c95e6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:17.802247 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:17.923572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd970a9d1e044e887d697e2f76c95e6', 'request_id': 'req-fcbb0026-7adb-466e-bdf6-31001efbb67b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:17.930659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd970a9d1e044e887d697e2f76c95e6', 'request_id': 'req-fcbb0026-7adb-466e-bdf6-31001efbb67b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.046660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd970a9d1e044e887d697e2f76c95e6', 'request_id': 'req-fcbb0026-7adb-466e-bdf6-31001efbb67b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.072866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] The token cache is being invalidate because project ccd970a9d1e044e887d697e2f76c95e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:18.073849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.074730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.076853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 923/1832] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:17 2022] DELETE /identity/v3/projects/ccd970a9d1e044e887d697e2f76c95e6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:18.086436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3e29-47fe-4511-853d-def564c76b7d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.087332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3e29-47fe-4511-853d-def564c76b7d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.088416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3e29-47fe-4511-853d-def564c76b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.102254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.108043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:18.132221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4c1c3e29-47fe-4511-853d-def564c76b7d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:18.135470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4c1c3e29-47fe-4511-853d-def564c76b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:18.298942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 910/1833] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:18.299150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb0026-7adb-466e-bdf6-31001efbb67b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.301954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.301954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.302283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.304083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.304842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.305332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.305615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] PATH_INFO: `/v3/projects/894e7c88bdc64850b579fd6ef86120fb` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.307665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=894e7c88bdc64850b579fd6ef86120fb)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.309899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.329606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:18.330817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:18.342770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 911/1834] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:18.346860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.357080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cba9d-9c5e-46d9-a5d1-206cd82c6e3c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.363523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.364455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.364641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.364981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.365798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:18.366169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.368169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.390360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 912/1835] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:18.401045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.406715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0256-aeb1-49d7-b29c-abc4151f7997 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.412398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.413067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.413363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.413622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.414317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.416937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.489858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894e7c88bdc64850b579fd6ef86120fb', 'request_id': 'req-e23751a1-7575-4b2a-a4b7-40e180d14f2a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.498200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894e7c88bdc64850b579fd6ef86120fb', 'request_id': 'req-e23751a1-7575-4b2a-a4b7-40e180d14f2a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.561460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 913/1836] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:18 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:18.571659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.588470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894e7c88bdc64850b579fd6ef86120fb', 'request_id': 'req-e23751a1-7575-4b2a-a4b7-40e180d14f2a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.610583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] The token cache is being invalidate because project 894e7c88bdc64850b579fd6ef86120fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:18.610871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.611555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.613265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 924/1837] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:18 2022] DELETE /identity/v3/projects/894e7c88bdc64850b579fd6ef86120fb => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:18.617195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.620887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:18.686287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadbe1e-beda-41fe-9aab-5287c5eb5242 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.692161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.693426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.693696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.694202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.695171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.698168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.714216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23751a1-7575-4b2a-a4b7-40e180d14f2a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.719303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.720193 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.720476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.720753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] PATH_INFO: `/v3/users/127d8e7a20cf4e59a36ad979302596a2` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.721939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127d8e7a20cf4e59a36ad979302596a2)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.723863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.844514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 914/1838] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:18 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:18.844514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.844514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:18.852460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405f0c7-ad6a-4b83-9dc8-cc822e2e4bc5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.857413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.858596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.858596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.858771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.859724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.861856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.880503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 915/1839] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:18.884359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.895079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a9fb-b019-4201-a441-3c70f23e5ef9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.899826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.904345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.904345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.904345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.904345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.904345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.919667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 916/1840] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:18.921240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:18.932773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97d6c-ce35-4ea0-b878-83a390a79f6f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:18.939687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:18.940886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:18.941179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:18.941456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] PATH_INFO: `/v3/projects/8d27072393b34259af3f7ff1d09a086f/users/d5840d955aa84432aaa6f523bde9609c/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:18.965098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d27072393b34259af3f7ff1d09a086f, user_id=d5840d955aa84432aaa6f523bde9609c, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:18.967527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127d8e7a20cf4e59a36ad979302596a2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.968137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f97b8-985d-4fb5-bcaa-b2c87d157817 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:18.968261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127d8e7a20cf4e59a36ad979302596a2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:18.977070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127d8e7a20cf4e59a36ad979302596a2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.045040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127d8e7a20cf4e59a36ad979302596a2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.050970 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 917/1841] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:18 2022] PUT /identity/v3/projects/8d27072393b34259af3f7ff1d09a086f/users/d5840d955aa84432aaa6f523bde9609c/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:19.058744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127d8e7a20cf4e59a36ad979302596a2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.062105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.062498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.062872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.065198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 925/1842] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:18 2022] DELETE /identity/v3/users/127d8e7a20cf4e59a36ad979302596a2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:19.091930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] MFA Rules not processed for user `d5840d955aa84432aaa6f523bde9609c`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:19.093272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.179057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 918/1843] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:19.193360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.194712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.276220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16cee9-0999-4a58-8d64-eadaaf4bbee9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.281052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.281722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.282059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.283094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.283094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.285057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.382192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 926/1844] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:19.387722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.401578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad0969-df0b-4556-8fcd-2be89240234b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.472716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.473502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.473787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.474059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.474745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.477183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.489034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.490963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.518493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b36cf-eca4-4ceb-a45b-4b50343d25be admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.523890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.525066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.525066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.525887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] PATH_INFO: `/v3/projects/615d007798334bcc91c640ed75345812` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.527150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=615d007798334bcc91c640ed75345812)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.529145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.581299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 919/1845] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:19.582571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.603147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086da3-344b-436d-adb2-282af7ef9135 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.609670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.610392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.610674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.610948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.611709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.613374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.625010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 920/1846] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:19.629095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.639784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963d13-139e-4995-bd9a-548aa4b003b1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.645479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.646586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.646586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.646825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.647445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.649090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.660868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 921/1847] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:19.665159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.675744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf967d-2c8e-4e05-86a9-fe0ff70556a3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.683235 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615d007798334bcc91c640ed75345812', 'request_id': 'req-31c8a6e9-605f-4509-aca9-4740629db1eb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.691299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615d007798334bcc91c640ed75345812', 'request_id': 'req-31c8a6e9-605f-4509-aca9-4740629db1eb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.734613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.735424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.735710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.736034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] PATH_INFO: `/v3/projects/c1406423dc454db5b1696397aa24add3/users/9759c0fbb0194f18a091696a5f6a1442/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.752173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1406423dc454db5b1696397aa24add3, user_id=9759c0fbb0194f18a091696a5f6a1442, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.754809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68b3af-968d-4a4f-8945-11bdb1b6ee2a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.757799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615d007798334bcc91c640ed75345812', 'request_id': 'req-31c8a6e9-605f-4509-aca9-4740629db1eb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.772874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] The token cache is being invalidate because project 615d007798334bcc91c640ed75345812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:19.773160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.773825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-31c8a6e9-605f-4509-aca9-4740629db1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:19.775899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 927/1848] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:19 2022] DELETE /identity/v3/projects/615d007798334bcc91c640ed75345812 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:19.781583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99fbb-c61e-4739-bdfc-d3235af63299 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.781865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99fbb-c61e-4739-bdfc-d3235af63299 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.782139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac99fbb-c61e-4739-bdfc-d3235af63299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.806457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9ac99fbb-c61e-4739-bdfc-d3235af63299 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:19.807959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9ac99fbb-c61e-4739-bdfc-d3235af63299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.816306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 928/1849] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:19.824965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.825255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.825541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.838733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 922/1850] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:19 2022] PUT /identity/v3/projects/c1406423dc454db5b1696397aa24add3/users/9759c0fbb0194f18a091696a5f6a1442/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:19.846022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:19.848774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.852117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.852409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.852684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.886617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] MFA Rules not processed for user `9759c0fbb0194f18a091696a5f6a1442`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:19.888062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.910798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 929/1851] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:19.915221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.926449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf586d64-0ced-42a6-af81-a77cc1d8dee3 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.931299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.932143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.932666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.932968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.933686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:19.933993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.935597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.948816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 930/1852] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:19.952919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.963807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d69b9-8d1f-4262-93ac-0dcea53f72d8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.969190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.969589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 923/1853] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:19.969870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.970153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.970432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.971128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:19.973144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:19.974475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:19.976178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:19.991991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f59871-f6d8-48da-96b7-b45ebde114aa None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:19.996752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:19.997405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:19.997683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:19.997980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:19.998762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.001097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.098249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 931/1854] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:20.102401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.112407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 924/1855] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:19 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:20.115548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.172613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649160f2-658b-4bc5-b97f-0e7511792f1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.189468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480816-b2ae-49df-bae3-397a5adf25f1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.194461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.195125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.195407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.195678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.196405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.198921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.237004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.237679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.237962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.238238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.238925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.240884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.274812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 925/1856] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:20 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:20.283582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.294899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37894-4c55-4564-a749-6782aa7960a6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.299580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.300278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.300558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.301123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.302016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.303588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.314838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 926/1857] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:20.323117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.334003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b156422-69a5-4c06-b032-a5bdb89bb1b6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.339163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.343228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.343228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.343228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] PATH_INFO: `/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e/users/030c6c920b8843fa9d1afbe3feac7776/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.358716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7fd6aca83546d1a6562e029aeb6a6e, user_id=030c6c920b8843fa9d1afbe3feac7776, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.361556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.367360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 932/1858] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:20 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:20.372443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.382728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd8ecc-d035-4851-9954-1af460fa665f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.388428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.391451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.391451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.391451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.391451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.391998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.402434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 933/1859] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:20.406553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.416927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa805743-44af-4c84-99a3-084290f075d5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.422108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.422855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.423226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.423528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.424333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.425980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.436592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 927/1860] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:20 2022] PUT /identity/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e/users/030c6c920b8843fa9d1afbe3feac7776/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:20.440595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 934/1861] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:20.440896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.449356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.459340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0828-ed4a-458f-996e-14a243bdb64d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.502753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e6b74-d40c-496c-8684-c27f15f8b350 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.507825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.508527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.508816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.509187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.510714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.512422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.528987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.528987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.528987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.528987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] PATH_INFO: `/v3/projects/941398b3a9594c6f864517882590c4dc/users/57e26f20b607406999b0ce90e6f25e73/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.533983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 928/1862] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:20.534870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.543038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941398b3a9594c6f864517882590c4dc, user_id=57e26f20b607406999b0ce90e6f25e73, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.545032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ad61b-d62c-4f3f-b515-af4a35918cba admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.545704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf683-c7f8-4aa8-a836-fed34d1fa4f0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.550256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.551144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.551433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.551737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] PATH_INFO: `/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e/users/030c6c920b8843fa9d1afbe3feac7776/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.553753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7fd6aca83546d1a6562e029aeb6a6e, user_id=030c6c920b8843fa9d1afbe3feac7776, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.557101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62d427-8782-4d80-a5f0-b7ccbc7a74e9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.567845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 929/1863] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:20 2022] PUT /identity/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e/users/030c6c920b8843fa9d1afbe3feac7776/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:20.579489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.579781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.580193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.609182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] MFA Rules not processed for user `030c6c920b8843fa9d1afbe3feac7776`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:20.610442 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:20.630104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 935/1864] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:20 2022] PUT /identity/v3/projects/941398b3a9594c6f864517882590c4dc/users/57e26f20b607406999b0ce90e6f25e73/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:20.639574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.639861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.640230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.657772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:20.658978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:20.690242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 930/1865] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:20 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:20.700969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.702598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:20.726210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 936/1866] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:20.736990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:20.738636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:20.773283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c549b-e81f-4a2f-a4da-0a3a64047cb8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.803152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2941f-fd14-445f-af9d-9620abc8360b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:20.808386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.812250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.812250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.812250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.819931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.821429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.832620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 937/1867] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:20.834532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:20.835191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:20.835479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:20.835757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:20.897388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:20.898920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66a13-32e8-4521-92af-14377f19ff29 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:20.910074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 931/1868] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:20 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:21.038716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:21.040143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:21.055224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68284341-2fa5-4542-8259-edb5004bca34 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:21.059526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:21.060219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:21.060525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:21.060798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:21.062628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:21.131175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:21.133424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:21.153880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 938/1869] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:21 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:22.160403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.161122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.161122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.190451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] MFA Rules not processed for user `57e26f20b607406999b0ce90e6f25e73`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:22.191928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:22.270147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 932/1870] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:22 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:22.274807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.292247 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5f71a-56fd-4fa5-b91f-b0bd5581df4d service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.303578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.303578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.303578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.303578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.304135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.304135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.417600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 939/1871] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:22 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:22.418715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.430082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0223bb2-a6ae-4474-bdf9-16b0e9397757 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.487426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.488123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.488407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.488682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.489365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.491311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.566481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 933/1872] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:22 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:22.570458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.581630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9f8f0-00b5-43e6-bbc9-383ffb848cae admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.586599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.587311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.587726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.588041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.588859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.590654 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.602118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 940/1873] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:22.606871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.617366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e67fa-df8c-4c68-a4bd-da6a275a5223 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.622760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.623648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.623932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.624244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] PATH_INFO: `/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e/users/67e167f3a34d4cb1aeaea59540f049a6/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.639704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b9c3ef9d7a47ceaf97db962d751b7e, user_id=67e167f3a34d4cb1aeaea59540f049a6, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.642637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.699303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 934/1874] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:22 2022] PUT /identity/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e/users/67e167f3a34d4cb1aeaea59540f049a6/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:22.703292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.713797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f652-8072-4998-9dc6-ee3b427018ff admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.772963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.773767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.774141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.774424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.775795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.777851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deca7e-d528-4f05-a9ee-41fe9bba843b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.789853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 941/1875] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:22.794572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:22.804682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00543694-bd29-4f58-9163-618ee9697711 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:22.809603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:22.810482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:22.810765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:22.811036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] PATH_INFO: `/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e/users/67e167f3a34d4cb1aeaea59540f049a6/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:22.813053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b9c3ef9d7a47ceaf97db962d751b7e, user_id=67e167f3a34d4cb1aeaea59540f049a6, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:22.815660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:22.826672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 935/1876] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:22 2022] PUT /identity/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e/users/67e167f3a34d4cb1aeaea59540f049a6/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:24.365002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.365002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.365002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.392258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] MFA Rules not processed for user `67e167f3a34d4cb1aeaea59540f049a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:24.393468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:24.464245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 942/1877] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:24 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:24.475049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:24.532082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc0723-c526-489a-b6bf-bdf8fc7e71a8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:24.535761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:24.536464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:24.536749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:24.537024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:24.591829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:24.593293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:24.602130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 936/1878] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:24 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:27.457119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.469290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37a7d-23b6-4d90-ae78-183695a24b06 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.473508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.474244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.474630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.474912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.486743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.488482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62062a9a-fbb3-435d-b7fd-0c97a6b3f137 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.501329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 943/1879] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:27 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:27.623742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:27.691046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e4cfd-467d-4ceb-a4f4-abcf62cf8562 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:27.697550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:27.698661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:27.699010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:27.699294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] PATH_INFO: `/v3/users/d5840d955aa84432aaa6f523bde9609c` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:27.700533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5840d955aa84432aaa6f523bde9609c)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:27.702609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:27.899345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5840d955aa84432aaa6f523bde9609c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:27.909162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5840d955aa84432aaa6f523bde9609c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:27.925316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5840d955aa84432aaa6f523bde9609c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.014936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5840d955aa84432aaa6f523bde9609c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.015911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5840d955aa84432aaa6f523bde9609c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.028826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 937/1880] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:27 2022] DELETE /identity/v3/users/d5840d955aa84432aaa6f523bde9609c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:28.031056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:28.031348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:28.031622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:28.051527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:28.052836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:28.118087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 944/1881] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:28.128280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:28.129751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:28.188140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124dd89-dfbe-405b-8140-22b5ad3fd81c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:28.191816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:28.192483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:28.192764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:28.193032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:28.202464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:28.203879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:28.213751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 938/1882] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:28.680375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:28.687146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:28.705066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131907db-a913-4db3-9eb4-17795f3f595f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:28.711895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:28.727151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:28.727151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:28.727151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] PATH_INFO: `/v3/projects/8d27072393b34259af3f7ff1d09a086f` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:28.727151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d27072393b34259af3f7ff1d09a086f)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:28.727151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:28.861947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d27072393b34259af3f7ff1d09a086f', 'request_id': 'req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.869959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d27072393b34259af3f7ff1d09a086f', 'request_id': 'req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.972333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d27072393b34259af3f7ff1d09a086f', 'request_id': 'req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.988741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] The token cache is being invalidate because project 8d27072393b34259af3f7ff1d09a086f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:28.989022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.989913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:28.998055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 945/1883] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:28 2022] DELETE /identity/v3/projects/8d27072393b34259af3f7ff1d09a086f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:28.999258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:29.012016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b889-06d2-472f-b268-78fba2e06425 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:29.094406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:29.095436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:29.095729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:29.096040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] PATH_INFO: `/v3/users/9759c0fbb0194f18a091696a5f6a1442` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:29.097419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9759c0fbb0194f18a091696a5f6a1442)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:29.099400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:29.337091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9759c0fbb0194f18a091696a5f6a1442'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:29.344112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9759c0fbb0194f18a091696a5f6a1442'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:29.355859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9759c0fbb0194f18a091696a5f6a1442'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:29.426615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9759c0fbb0194f18a091696a5f6a1442'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:29.427361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9759c0fbb0194f18a091696a5f6a1442'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:29.438309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 939/1884] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:28 2022] DELETE /identity/v3/users/9759c0fbb0194f18a091696a5f6a1442 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:29.865162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:29.865618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:29.883452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e85e-3a23-42aa-95ff-8a5ba7cf85a1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:29.949625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:29.950494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:29.950786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:29.951215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] PATH_INFO: `/v3/projects/c1406423dc454db5b1696397aa24add3` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:29.952309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1406423dc454db5b1696397aa24add3)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:29.954465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:30.076680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1406423dc454db5b1696397aa24add3', 'request_id': 'req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.084157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1406423dc454db5b1696397aa24add3', 'request_id': 'req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.155276 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1406423dc454db5b1696397aa24add3', 'request_id': 'req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.169575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] The token cache is being invalidate because project c1406423dc454db5b1696397aa24add3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:30.169575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.169575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.169842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 946/1885] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:29 2022] DELETE /identity/v3/projects/c1406423dc454db5b1696397aa24add3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:30.173976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:30.175320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:30.189864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a150562-452e-43fc-b5fd-5954b5d6c254 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:30.257356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:30.258250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:30.258520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:30.258799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] PATH_INFO: `/v3/users/030c6c920b8843fa9d1afbe3feac7776` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:30.260776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030c6c920b8843fa9d1afbe3feac7776)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:30.263155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:30.488604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030c6c920b8843fa9d1afbe3feac7776'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.496596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030c6c920b8843fa9d1afbe3feac7776'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.509319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030c6c920b8843fa9d1afbe3feac7776'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.598278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030c6c920b8843fa9d1afbe3feac7776'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.599874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030c6c920b8843fa9d1afbe3feac7776'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:30.608322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 940/1886] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:30 2022] DELETE /identity/v3/users/030c6c920b8843fa9d1afbe3feac7776 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:30.917205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:30.918753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:30.933036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a0dde-afa6-4f2f-b87c-2d3ace567f9e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.007082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.008729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.009158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.009604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] PATH_INFO: `/v3/users/891908e1e9c8409ba9e91e341d08825e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.011816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891908e1e9c8409ba9e91e341d08825e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.015175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.191141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.192877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.207262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33869433-9893-41ed-a1ee-5c693ef90c64 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.212247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.214351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.214351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.214583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] PATH_INFO: `/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.215682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7fd6aca83546d1a6562e029aeb6a6e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.217916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.311237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891908e1e9c8409ba9e91e341d08825e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.311956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891908e1e9c8409ba9e91e341d08825e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.319107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891908e1e9c8409ba9e91e341d08825e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.364782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7fd6aca83546d1a6562e029aeb6a6e', 'request_id': 'req-f1540b3b-def3-4f6f-933f-322bac0c2913'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.370563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7fd6aca83546d1a6562e029aeb6a6e', 'request_id': 'req-f1540b3b-def3-4f6f-933f-322bac0c2913'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.409901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891908e1e9c8409ba9e91e341d08825e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.423847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a12c6a4-483d-4c85-8b05-0b1ce3d7c693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891908e1e9c8409ba9e91e341d08825e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.429927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 947/1887] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:30 2022] DELETE /identity/v3/users/891908e1e9c8409ba9e91e341d08825e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:31.500764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7fd6aca83546d1a6562e029aeb6a6e', 'request_id': 'req-f1540b3b-def3-4f6f-933f-322bac0c2913'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.513699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] The token cache is being invalidate because project 6c7fd6aca83546d1a6562e029aeb6a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:31.513996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.514692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f1540b3b-def3-4f6f-933f-322bac0c2913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.516337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 941/1888] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:31 2022] DELETE /identity/v3/projects/6c7fd6aca83546d1a6562e029aeb6a6e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:31.522944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.523241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.523516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.542567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:31.543865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.610279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 948/1889] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:31.620533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.620825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.621104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.640671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:31.642130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.650366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 942/1890] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:31.654937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.665739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dfabe-e902-4511-8486-6bfd72fe2ff3 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.671143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.672060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.672349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.672790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.673565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:31.673946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.675586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.693190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 949/1891] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:31.693287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.693798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.694514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:31.705720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f891c8-26dc-48af-b5fe-11c1a29c1791 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.707571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece43b0-f8d0-4f79-baca-56798c5b5f14 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.710660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.711322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.711746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.712058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.712492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.712933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.713389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.713834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.714375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] PATH_INFO: `/v3/projects/b22dd75c99404b48a867a48eb5d10c7d` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.716283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22dd75c99404b48a867a48eb5d10c7d)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.718202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.720229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.807128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 950/1892] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:31.810216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:31.881230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22dd75c99404b48a867a48eb5d10c7d', 'request_id': 'req-65b82870-7561-4b98-b025-47b1fa08e7ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.887005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08752e-217d-4349-810f-adc7ab5eeb74 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:31.894848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22dd75c99404b48a867a48eb5d10c7d', 'request_id': 'req-65b82870-7561-4b98-b025-47b1fa08e7ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:31.955707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:31.956408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:31.956714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:31.956961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:31.957656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:31.959801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:31.990000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22dd75c99404b48a867a48eb5d10c7d', 'request_id': 'req-65b82870-7561-4b98-b025-47b1fa08e7ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:32.003603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] The token cache is being invalidate because project b22dd75c99404b48a867a48eb5d10c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:32.003874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:32.005072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65b82870-7561-4b98-b025-47b1fa08e7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:32.006620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 943/1893] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:31 2022] DELETE /identity/v3/projects/b22dd75c99404b48a867a48eb5d10c7d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:32.013137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e31e8-5aca-4755-a656-afe001f4225d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.013427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e31e8-5aca-4755-a656-afe001f4225d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.013707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e31e8-5aca-4755-a656-afe001f4225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.033591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7e8e31e8-5aca-4755-a656-afe001f4225d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:32.036081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7e8e31e8-5aca-4755-a656-afe001f4225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.043067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 944/1894] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:32.051160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.051447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.051725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.069586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:32.070767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.079745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 945/1895] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:32.083905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.084071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 951/1896] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:31 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:32.092115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.094036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.094476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bd54-e0c4-4573-924e-1e4434bbe860 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.101317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.102139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.102409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.102686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.103937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:32.103937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.105827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.107589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf20b9-ceac-45a5-8c50-503f5a4d77bc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.112793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.113453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.113733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.114006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.114724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.116346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.125535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 946/1897] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:32.126545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.126980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 952/1898] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.139358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.148694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c12a5-b894-4c4d-ae57-75a1a2aba941 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.155420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.163499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d85980-494f-406c-9af6-b00553dcdaa9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.164145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.164145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.164145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.164145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.164145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.164478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.164478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.164478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.164478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.164719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.165806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.178629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 953/1899] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.183089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.193386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264fecf-e75c-42e0-835a-d785b3f3642f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.198687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.199563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.199900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.200313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] PATH_INFO: `/v3/projects/b9f4e304205140aa80a1b5de2e221bc5/users/9381d56c07464e25bcd60438d3da57ef/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.218043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f4e304205140aa80a1b5de2e221bc5, user_id=9381d56c07464e25bcd60438d3da57ef, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.220962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046542e6-0b31-4786-bc3e-b0974957e28b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.239834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 947/1900] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:32.244027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.313374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ec9e-601a-454b-bfa8-4c8a30b257b7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.318242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.318961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.319251 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.319526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.320326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.322245 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.401226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 954/1901] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:32 2022] PUT /identity/v3/projects/b9f4e304205140aa80a1b5de2e221bc5/users/9381d56c07464e25bcd60438d3da57ef/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:32.412528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.412821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.413102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.430094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 948/1902] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:32.439437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.444201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] MFA Rules not processed for user `9381d56c07464e25bcd60438d3da57ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:32.445414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.452191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d848-f7c8-4414-a3fe-c10e6bd3f10f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.517532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.517843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.518137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.518425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.519152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.519258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 955/1903] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:32.520851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.531214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.532484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 949/1904] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.532626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.542545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.552443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2afc46-4810-40af-9775-444b1177a462 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.558871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.559659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.559941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.560255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.560980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.562585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.576011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 950/1905] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:32.578264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.588230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970166-6d83-4084-a690-5e31b80040f9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.593293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.594391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.594492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.594811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] PATH_INFO: `/v3/projects/2b66ddee4c864aae90b738695dffbeb9/users/b019715a14074e059730965913694e52/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.595545 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b30ad-0c98-4320-8dce-4d394655646d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.599251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.599892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.600213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.600481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.609479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.609781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b66ddee4c864aae90b738695dffbeb9, user_id=b019715a14074e059730965913694e52, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.610930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.612910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a37acc-25e5-4b59-8406-5ab3884a6dc7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.621095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 956/1906] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:32.645835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.656987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf06f-bb71-431c-bca2-357fc247615e service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.662007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.663435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.663902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.664259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] PATH_INFO: `/v3/users/9381d56c07464e25bcd60438d3da57ef` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.669132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9381d56c07464e25bcd60438d3da57ef)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.669132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.696920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 951/1907] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:32 2022] PUT /identity/v3/projects/2b66ddee4c864aae90b738695dffbeb9/users/b019715a14074e059730965913694e52/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:32.702101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.706362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.706362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.725285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:32.726598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.797205 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 952/1908] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:32.809065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:32.810614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:32.870429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee8731-9306-471b-9fdf-b02eb41a448a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:32.874085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:32.874787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:32.874987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:32.875262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:32.888330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:32.889807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282701d-cb3d-4f05-9d84-c3dfb9d5745e service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:32.903405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 953/1909] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:32.938740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9381d56c07464e25bcd60438d3da57ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:32.939395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9381d56c07464e25bcd60438d3da57ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:32.946693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9381d56c07464e25bcd60438d3da57ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:33.063941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9381d56c07464e25bcd60438d3da57ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:33.077220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9381d56c07464e25bcd60438d3da57ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:33.083406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 957/1910] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:32 2022] DELETE /identity/v3/users/9381d56c07464e25bcd60438d3da57ef => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:33.088729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:33.089877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:33.090152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:33.109627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:33.110852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:33.193915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 954/1911] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:33.204455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:33.205887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:33.281543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee84c4-8c0f-4716-bddb-4039f950499e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:33.285486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:33.286064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:33.286344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:33.286617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:33.297694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:33.299121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e7559-41a9-45c4-b259-08f1adc64583 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:33.308655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 958/1912] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:33.774470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:33.789337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:33.796341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16def7f9-4f81-49f2-a8a3-175ca1022e26 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:33.800940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:33.801914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:33.802206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:33.802484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] PATH_INFO: `/v3/projects/b9f4e304205140aa80a1b5de2e221bc5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:33.803720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f4e304205140aa80a1b5de2e221bc5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:33.806772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:33.952989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f4e304205140aa80a1b5de2e221bc5', 'request_id': 'req-b19bdd1e-c979-4348-8934-c441fc4f080b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:33.958575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f4e304205140aa80a1b5de2e221bc5', 'request_id': 'req-b19bdd1e-c979-4348-8934-c441fc4f080b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:34.053773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f4e304205140aa80a1b5de2e221bc5', 'request_id': 'req-b19bdd1e-c979-4348-8934-c441fc4f080b'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:34.066625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] The token cache is being invalidate because project b9f4e304205140aa80a1b5de2e221bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:34.067644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:34.068578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b19bdd1e-c979-4348-8934-c441fc4f080b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:34.070196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 955/1913] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:33 2022] DELETE /identity/v3/projects/b9f4e304205140aa80a1b5de2e221bc5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:34.077031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.077546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.077656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.096870 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:34.098085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.162632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 959/1914] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:34.170833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.171404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.171861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.193861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:34.195087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.208586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 956/1915] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:34.213309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.224300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d22650-db04-4bb8-a08f-b80dc50091ec None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.230884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.231600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.232002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.232480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.233317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:34.233865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.235596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.249113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 960/1916] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:34.259265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.271593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca237dc7-38ca-456d-9c44-fb58a305a05f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.281090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.281090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.281090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.281090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.281861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.283906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d73b8f-16ca-4fc1-a6f6-b37eef23cb4a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.416901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 957/1917] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:34.423700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.435779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00687-9ed4-4079-b88a-515c1acf3ec0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.498739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.499429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.500248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.500544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.501743 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.505496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.539200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282d9a-a441-4d6f-bcd7-eb2db0855442 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.539494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282d9a-a441-4d6f-bcd7-eb2db0855442 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.539774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282d9a-a441-4d6f-bcd7-eb2db0855442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.584402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ef282d9a-a441-4d6f-bcd7-eb2db0855442 None None] MFA Rules not processed for user `b019715a14074e059730965913694e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:34.585754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ef282d9a-a441-4d6f-bcd7-eb2db0855442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.617606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 961/1918] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:34.622711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.634494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c620dfd-06b5-44f4-af3b-3c9a75d978af admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.640367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.641053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.641343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.641618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.642727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.644704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.659890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 962/1919] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:34.661010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.673171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 958/1920] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:34.675145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.675542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.675928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.683034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ea24-a9e2-4bb1-a87d-b9f0759dfde0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.688508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.689477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.689913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.690517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.691564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.693442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.701126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] MFA Rules not processed for user `b019715a14074e059730965913694e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:34.702348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.707216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 963/1921] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:34.711251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.711602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 959/1922] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:34.722614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fde2-c028-439e-b8c0-f006c216d6af admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.724938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:34.726662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.727910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.729216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.729590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.730124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] PATH_INFO: `/v3/projects/328131fd3ad64205a4928d00c2bb8c23/users/bd5d9ed0db1e4efcad0dfddb7291c658/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.748015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=328131fd3ad64205a4928d00c2bb8c23, user_id=bd5d9ed0db1e4efcad0dfddb7291c658, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.751886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492b39a-f1ba-4de4-a058-f3579cc7dfea admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.820188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39270649-8781-43f6-8571-b5d5400ae096 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:34.828148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:34.829013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.829307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.830996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.857138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:34.859496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:34.867582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 964/1923] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:34 2022] PUT /identity/v3/projects/328131fd3ad64205a4928d00c2bb8c23/users/bd5d9ed0db1e4efcad0dfddb7291c658/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:34.871678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 960/1924] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:34 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:34.879068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84280-aaa0-4358-8f97-703df3fc6760 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:34.879364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84280-aaa0-4358-8f97-703df3fc6760 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:34.879646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd84280-aaa0-4358-8f97-703df3fc6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:34.912686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bfd84280-aaa0-4358-8f97-703df3fc6760 None None] MFA Rules not processed for user `bd5d9ed0db1e4efcad0dfddb7291c658`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:34.913906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bfd84280-aaa0-4358-8f97-703df3fc6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:34.987916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 965/1925] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:34 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:34.998795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:35.000552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:35.067855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88724-a505-4418-a0db-2cbd747d40ce service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:35.121765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:35.122419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:35.122704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:35.122981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:35.140967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:35.142773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:35.153816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 961/1926] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:34 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:36.952676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677874-260e-4a62-8380-40aa3b9023f5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:36.953132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677874-260e-4a62-8380-40aa3b9023f5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:36.953409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677874-260e-4a62-8380-40aa3b9023f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:36.972933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a4677874-260e-4a62-8380-40aa3b9023f5 None None] MFA Rules not processed for user `bd5d9ed0db1e4efcad0dfddb7291c658`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:36.974250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a4677874-260e-4a62-8380-40aa3b9023f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:36.981666 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 966/1927] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:36 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:46.023096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:46.025448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:46.172253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cda123-38c6-4d4c-b595-c1d970b56e69 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:46.177651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:46.178812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:46.179279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:46.179696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] PATH_INFO: `/v3/users/913263abe3d8426bb44daa9b6f80ba0a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:46.181140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] RBAC: Authorizing `identity:delete_user(user_id=913263abe3d8426bb44daa9b6f80ba0a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:46.191547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:46.461973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913263abe3d8426bb44daa9b6f80ba0a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:46.472264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913263abe3d8426bb44daa9b6f80ba0a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:46.489747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913263abe3d8426bb44daa9b6f80ba0a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:46.571896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913263abe3d8426bb44daa9b6f80ba0a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:46.572588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913263abe3d8426bb44daa9b6f80ba0a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:46.579444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 962/1928] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:46 2022] DELETE /identity/v3/users/913263abe3d8426bb44daa9b6f80ba0a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:46.584211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:46.584680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:46.584813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:46.626218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:46.627559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:46.730386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 967/1929] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:46 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:46.740562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:46.742347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:46.837317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f044d-b5c6-4074-9936-b1e5489639df admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:46.843308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:46.844455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:46.844738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:46.845086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:46.858359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:46.859956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92b976-65fe-4906-a97d-1c91c3eba0c9 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:46.884820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 963/1930] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:46 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:47.322174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:47.323892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:47.337277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f56c-0643-4cf0-b43b-77c833e720f9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:47.345740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:47.346705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.346910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.347224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] PATH_INFO: `/v3/projects/a366c48c3423449ba15709777e5868cb` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.348722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a366c48c3423449ba15709777e5868cb)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:47.351233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:47.474396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a366c48c3423449ba15709777e5868cb', 'request_id': 'req-2bc461b4-3a02-419f-a996-3d468d3b7c58'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:47.486376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a366c48c3423449ba15709777e5868cb', 'request_id': 'req-2bc461b4-3a02-419f-a996-3d468d3b7c58'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:47.566366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a366c48c3423449ba15709777e5868cb', 'request_id': 'req-2bc461b4-3a02-419f-a996-3d468d3b7c58'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:47.582871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] The token cache is being invalidate because project a366c48c3423449ba15709777e5868cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:47.583706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:47.584708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-2bc461b4-3a02-419f-a996-3d468d3b7c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:47.588608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 968/1931] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:47 2022] DELETE /identity/v3/projects/a366c48c3423449ba15709777e5868cb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:47.596198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.597426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.597945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.643858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:47.645197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:47.720169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 964/1932] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:47.729753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.730118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.730473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.767169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:47.768455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:47.776607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 969/1933] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:47.781106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:47.790994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee737053-4634-4aa4-bbfb-de52e5ef1ad6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:47.796788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:47.797608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.797882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.798163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.798896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:47.799209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:47.800948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:47.831448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:47.832998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:47.848053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 965/1934] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:07:47.849919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:47.854599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154cad2-1dca-41ea-9ad3-eecbf754d364 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:47.862283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfde15-a873-4498-940f-b0f095558966 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:47.867322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:47.868071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:47.868800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.868917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:47.869080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.869180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:47.869352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] PATH_INFO: `/v3/users/57e26f20b607406999b0ce90e6f25e73` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.869596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:47.870372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:47.873115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:47.873570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e26f20b607406999b0ce90e6f25e73)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:47.879463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:47.962100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 966/1935] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:47 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:47.969137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.060063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90195-5fa9-43d7-8a61-42e23a5de4ff admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.060993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.061696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.061972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.062252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.062965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.065027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.129295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e26f20b607406999b0ce90e6f25e73'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.130333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e26f20b607406999b0ce90e6f25e73'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.147006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e26f20b607406999b0ce90e6f25e73'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.247366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 967/1936] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:47 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:48.247366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.248841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.249809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e26f20b607406999b0ce90e6f25e73'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.262547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c401b-e219-4460-ac53-9072ce147c31 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.265230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e26f20b607406999b0ce90e6f25e73'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.268242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.269179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.269527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.269864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] PATH_INFO: `/v3/users/92a6689fcf95455bb6aff0a428192d98` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.272081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a6689fcf95455bb6aff0a428192d98)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.273503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.280368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 970/1937] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:47 2022] DELETE /identity/v3/users/57e26f20b607406999b0ce90e6f25e73 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:48.281281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.284171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.395547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce258b2-858d-4c90-944f-4d4b8d419cd3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.402338 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.412183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.412183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.412183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.412183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.412183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.423061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 971/1938] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:48.427109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.437805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1911e-c30f-4710-89fc-9cd766dcdad4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.443199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.443896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.444559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.444559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.445332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.446994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.457956 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 972/1939] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:48.462528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.473177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf5eb-ad7a-493e-982c-d74757937513 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.478671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.479677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.479904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.480220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] PATH_INFO: `/v3/projects/38716ffbfde64622b70c6c1a5b660fa8/users/89e008771b9a4c24b879466a755a3870/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.497966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38716ffbfde64622b70c6c1a5b660fa8, user_id=89e008771b9a4c24b879466a755a3870, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.501745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240111f0-4758-45d3-9ecb-517ce0e3156c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.522715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a6689fcf95455bb6aff0a428192d98'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.530514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a6689fcf95455bb6aff0a428192d98'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.543688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a6689fcf95455bb6aff0a428192d98'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.605171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 973/1940] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:48 2022] PUT /identity/v3/projects/38716ffbfde64622b70c6c1a5b660fa8/users/89e008771b9a4c24b879466a755a3870/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:48.616257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf381-00be-4536-a74c-47a73402c996 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.616766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf381-00be-4536-a74c-47a73402c996 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.617272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcf381-00be-4536-a74c-47a73402c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.627542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a6689fcf95455bb6aff0a428192d98'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.629049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a6689fcf95455bb6aff0a428192d98'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.643335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 968/1941] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:48 2022] DELETE /identity/v3/users/92a6689fcf95455bb6aff0a428192d98 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:48.644979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.646695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.666051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ccbcf381-00be-4536-a74c-47a73402c996 None None] MFA Rules not processed for user `89e008771b9a4c24b879466a755a3870`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:48.666051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ccbcf381-00be-4536-a74c-47a73402c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.741656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 974/1942] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:48 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:48.743043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.743333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.744096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.757311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa18ee-cd3d-40b8-911c-59362650a2ba admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.768455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.769337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.769627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.769905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] PATH_INFO: `/v3/projects/941398b3a9594c6f864517882590c4dc` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.771102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:48.771247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941398b3a9594c6f864517882590c4dc)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.772423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.773059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.786405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 975/1943] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:48.788438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.790348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.850723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0591-d250-4c32-a23d-bfd1cee25764 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:48.854927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:48.855580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:48.855908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:48.856329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:48.865119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:48.866555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:48.876779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 976/1944] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:48 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:48.877604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:48.878966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:48.922140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941398b3a9594c6f864517882590c4dc', 'request_id': 'req-18d3c76e-1096-4226-ac7e-b2c532d003f9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.932816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941398b3a9594c6f864517882590c4dc', 'request_id': 'req-18d3c76e-1096-4226-ac7e-b2c532d003f9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:48.989708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924be9b1-d5b4-43d6-ac6b-2c16debcd009 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.027003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.028264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.029334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.029334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.058497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941398b3a9594c6f864517882590c4dc', 'request_id': 'req-18d3c76e-1096-4226-ac7e-b2c532d003f9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.073149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] The token cache is being invalidate because project 941398b3a9594c6f864517882590c4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:49.073507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.115034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.115034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 969/1945] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:48 2022] DELETE /identity/v3/projects/941398b3a9594c6f864517882590c4dc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:49.115238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.115238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.115392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.115392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.119184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 977/1946] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:49.128965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c76e-1096-4226-ac7e-b2c532d003f9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.140950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] PATH_INFO: `/v3/users/67e167f3a34d4cb1aeaea59540f049a6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e167f3a34d4cb1aeaea59540f049a6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.186710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.524417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e167f3a34d4cb1aeaea59540f049a6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.532382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e167f3a34d4cb1aeaea59540f049a6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.545297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e167f3a34d4cb1aeaea59540f049a6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.617945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e167f3a34d4cb1aeaea59540f049a6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.623345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e167f3a34d4cb1aeaea59540f049a6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:49.628147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 970/1947] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:49 2022] DELETE /identity/v3/users/67e167f3a34d4cb1aeaea59540f049a6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:49.771596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.773061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.787805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd1a18-d8d8-4a67-9650-183940d772ca service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:49.861644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:49.862728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:49.863169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:49.863618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] PATH_INFO: `/v3/projects/969f13984e0246acb3a7876a57fd3b77` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:49.865018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] RBAC: Authorizing `identity:delete_project(project_id=969f13984e0246acb3a7876a57fd3b77)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:49.867111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:49.974032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:49.975609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:49.989752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2f1b7-8ee6-457b-8c1d-37d8e87c5442 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.014649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.015524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.015811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.016130 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] PATH_INFO: `/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.021730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b9c3ef9d7a47ceaf97db962d751b7e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.025042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.038057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969f13984e0246acb3a7876a57fd3b77', 'request_id': 'req-fda33204-f1b1-460d-b39f-5b10b172962e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.056013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969f13984e0246acb3a7876a57fd3b77', 'request_id': 'req-fda33204-f1b1-460d-b39f-5b10b172962e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.171993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969f13984e0246acb3a7876a57fd3b77', 'request_id': 'req-fda33204-f1b1-460d-b39f-5b10b172962e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.184958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] The token cache is being invalidate because project 969f13984e0246acb3a7876a57fd3b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:50.185528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.186220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.188140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 978/1948] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:49 2022] DELETE /identity/v3/projects/969f13984e0246acb3a7876a57fd3b77 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:50.191679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.193238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:50.199020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b9c3ef9d7a47ceaf97db962d751b7e', 'request_id': 'req-7f529040-85d1-46b6-8c14-52ae0aebc38c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.205577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b9c3ef9d7a47ceaf97db962d751b7e', 'request_id': 'req-7f529040-85d1-46b6-8c14-52ae0aebc38c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.275398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b9c3ef9d7a47ceaf97db962d751b7e', 'request_id': 'req-7f529040-85d1-46b6-8c14-52ae0aebc38c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.281533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda33204-f1b1-460d-b39f-5b10b172962e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.292678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] The token cache is being invalidate because project f9b9c3ef9d7a47ceaf97db962d751b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:50.293083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.294638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f529040-85d1-46b6-8c14-52ae0aebc38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.296634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 971/1949] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:49 2022] DELETE /identity/v3/projects/f9b9c3ef9d7a47ceaf97db962d751b7e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:50.302724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb9e1-f5c5-46bb-8948-63c90a0b666f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.303219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb9e1-f5c5-46bb-8948-63c90a0b666f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.303644 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eb9e1-f5c5-46bb-8948-63c90a0b666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.324072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f67eb9e1-f5c5-46bb-8948-63c90a0b666f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:50.326237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f67eb9e1-f5c5-46bb-8948-63c90a0b666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:50.360393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.362689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.363136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.363416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] PATH_INFO: `/v3/users/542bee751fc0410887c9e063427cfeac` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.364823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542bee751fc0410887c9e063427cfeac)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.366795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.398181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 972/1950] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:50.406561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.406850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.407126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.425313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:50.426518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:50.435509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 973/1951] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:50.439808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.448751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5693f-fe78-4502-9759-a28d801d8774 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.454586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.455250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.455538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.455817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.456587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:50.462751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.462751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.471202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 974/1952] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:50.475563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.485236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9987e9-f6f1-4b7c-9774-9a9130577998 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.491479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.491479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.491734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.491909 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.492787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.494935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.555604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542bee751fc0410887c9e063427cfeac'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.556329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542bee751fc0410887c9e063427cfeac'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.563088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542bee751fc0410887c9e063427cfeac'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.577267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 975/1953] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:50 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:50.581336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.648690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe01a6-c488-4f93-8e44-8584fd59a1be admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.654452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.659547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.659547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.659547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.659547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.659547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.683022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542bee751fc0410887c9e063427cfeac'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.703874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542bee751fc0410887c9e063427cfeac'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:50.710810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 979/1954] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:50 2022] DELETE /identity/v3/users/542bee751fc0410887c9e063427cfeac => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:50.740914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 976/1955] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:50 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:50.745198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.747383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:50.827999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b116a-4d02-4288-b457-c59fa4479c01 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.833301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.834101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.834460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.834807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.835553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.837464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.849393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 980/1956] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:50.853839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.865942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940f7e0-75c7-4cf1-8501-197bc4837519 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.870905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.872160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.872476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.872947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.873687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.875293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47816c-34a4-440b-a5aa-ae9bdd68ecf4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:50.886457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 977/1957] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:50.890781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:50.902382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0d26-8d25-4408-9f67-5521a83faf3b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:50.907832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:50.908771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:50.909056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:50.909333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] PATH_INFO: `/v3/projects/b3bbb70fe0f54bfcb551a568f070410c/users/c91b9fabc9074cc4b743a47d973ad8e8/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:50.930582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bbb70fe0f54bfcb551a568f070410c, user_id=c91b9fabc9074cc4b743a47d973ad8e8, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:50.934185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.051185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 981/1958] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:50 2022] PUT /identity/v3/projects/b3bbb70fe0f54bfcb551a568f070410c/users/c91b9fabc9074cc4b743a47d973ad8e8/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:51.053454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.053982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.054454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.085039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] MFA Rules not processed for user `c91b9fabc9074cc4b743a47d973ad8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:51.086807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.171037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 978/1959] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:51.175643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.243672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e6922-40d2-4e8c-9f64-f3b06b70bf6c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.250365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.250844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.251022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.251306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.252054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.254094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.315741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.317395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.334447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d976-cf97-41a6-a91e-ae0b93df8299 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.339469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.341424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.342069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.342455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] PATH_INFO: `/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.343761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d3a924e0d844de8511c2ef92ccdc1d)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.345905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.360626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 982/1960] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:51.364602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.427481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8627d-c59f-41ff-9f3f-a82451a8d2ce admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.432317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.432988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.433270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.433543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.435016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.437125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.500080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d3a924e0d844de8511c2ef92ccdc1d', 'request_id': 'req-fc52a99c-fd16-4726-aec0-9bee6aaf6635'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:51.505693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d3a924e0d844de8511c2ef92ccdc1d', 'request_id': 'req-fc52a99c-fd16-4726-aec0-9bee6aaf6635'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:51.547189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 983/1961] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:51.548235 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.558597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa51d-525f-410b-8040-ff1847b798f8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.617356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d3a924e0d844de8511c2ef92ccdc1d', 'request_id': 'req-fc52a99c-fd16-4726-aec0-9bee6aaf6635'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:51.619636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.620409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.620693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.620964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.622279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.624328 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.630220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] The token cache is being invalidate because project b2d3a924e0d844de8511c2ef92ccdc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:51.630523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:51.631198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-fc52a99c-fd16-4726-aec0-9bee6aaf6635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:51.632785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 979/1962] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:51 2022] DELETE /identity/v3/projects/b2d3a924e0d844de8511c2ef92ccdc1d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:51.634322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 984/1963] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:51.638989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.639183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2261a-a435-4918-bc5f-d1b61271299c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.652154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2261a-a435-4918-bc5f-d1b61271299c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.652154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2261a-a435-4918-bc5f-d1b61271299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.652972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.652972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b36c3f-3d55-4b46-a321-1895f7f99b5d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.657355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.658234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.658516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.658705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4cd2261a-a435-4918-bc5f-d1b61271299c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:51.658814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] PATH_INFO: `/v3/projects/0befcf08e33642a3978688628be9a933/users/0c6c9d7ce5484727b29d366e83dcc303/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.659955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4cd2261a-a435-4918-bc5f-d1b61271299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.668428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 980/1964] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:51.674419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0befcf08e33642a3978688628be9a933, user_id=0c6c9d7ce5484727b29d366e83dcc303, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.679174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.679174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.679174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.679440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.696349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:51.697561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.707998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 981/1965] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:51.710706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.723596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b7f9f-695f-45d5-a2d0-29b1741a4908 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.728124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.729069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.732456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.732740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.733489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:51.733825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.735405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.743709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 985/1966] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:51 2022] PUT /identity/v3/projects/0befcf08e33642a3978688628be9a933/users/0c6c9d7ce5484727b29d366e83dcc303/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:51.750444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 982/1967] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:51.750584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.751390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.761372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f47b0-6856-4149-9847-299484b44d44 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.811779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7284fc-073d-4e77-8d69-e4ed56c363c2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.816664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.817375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.817710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.817844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.818048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.818448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.818696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.818856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.819145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.820127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.820432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.823567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.831072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 986/1968] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:51.835389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.845540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fc658-11cd-4de9-94f0-ae3e682ad0da admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.850399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.851282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.851570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.851848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] PATH_INFO: `/v3/projects/0befcf08e33642a3978688628be9a933/users/0c6c9d7ce5484727b29d366e83dcc303/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.853858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0befcf08e33642a3978688628be9a933, user_id=0c6c9d7ce5484727b29d366e83dcc303, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.857227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26259d6f-f775-4c09-ae83-c3bdfac82913 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.868085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 987/1969] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:51 2022] PUT /identity/v3/projects/0befcf08e33642a3978688628be9a933/users/0c6c9d7ce5484727b29d366e83dcc303/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:51.880218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.880513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.880803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.900089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 983/1970] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:51.901164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.908233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] MFA Rules not processed for user `0c6c9d7ce5484727b29d366e83dcc303`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:51.909436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:51.963065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1e77-3698-4930-a4de-0cd5f3e5240f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:51.968664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:51.969323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:51.969609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:51.969886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:51.970575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:51.972530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:51.978635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 988/1971] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:07:51.989065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:51.992768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:52.046249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e41d-5b43-4227-a64d-716019bc297b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.049922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.050593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.050876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.051151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.052931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:52.085311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 984/1972] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:51 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:52.085311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.094286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162071b-7dca-4550-9b13-652b1d84285d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.099026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.099673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.100114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.100396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.101115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.102817 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.112966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 985/1973] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:52.115503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.116844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.117148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.126776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 989/1974] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:51 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:07:52.130597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666947aa-f1d9-4e05-bb63-1508be3117db admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.135805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.138926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.139342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.139501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.140264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.141871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd43eeb-73bb-4ddb-8614-f172023977d6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.156075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 986/1975] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:52.160340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.172495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defef80-34fe-4a78-ac45-a03dc0a7cb95 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.186145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.189497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.190159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.190669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] PATH_INFO: `/v3/projects/74c9736aa6a846f8bd1b603790f8e081/users/0f7e333c1a784e3dbf09327cabb5c717/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.209396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c9736aa6a846f8bd1b603790f8e081, user_id=0f7e333c1a784e3dbf09327cabb5c717, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.212549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.299042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 990/1976] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:52 2022] PUT /identity/v3/projects/74c9736aa6a846f8bd1b603790f8e081/users/0f7e333c1a784e3dbf09327cabb5c717/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:07:52.310167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.310534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.310736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.341150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] MFA Rules not processed for user `0f7e333c1a784e3dbf09327cabb5c717`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:52.342655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:52.414257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 987/1977] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:52 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:52.418999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.482293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f36728-21ac-4e93-9384-caa7cb399c44 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.487085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.487739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.488063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.488343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.489046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.490943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.634562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 991/1978] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:52 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:52.636985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.648822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023f3c-85d1-49ae-bc18-78409bf3b67e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.710166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.710914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.715868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.715868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.715868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.715868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.848257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 988/1979] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:52 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:52.851990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.863448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b27a-3878-4839-a270-ff0d00ded570 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.868122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.868790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.869070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.869340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.870058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.871651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:52.905400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 992/1980] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:52.909490 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:52.921447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8fd5-189d-463f-a647-718716da295a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:52.925939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:52.926820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:52.927095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:52.927363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] PATH_INFO: `/v3/projects/1fbd31910cc74f578370519a6827a490/users/cfb9d04f558642a4bf7e2fa37456f10e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:52.942330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbd31910cc74f578370519a6827a490, user_id=cfb9d04f558642a4bf7e2fa37456f10e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:52.944972 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:53.028247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 989/1981] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:52 2022] PUT /identity/v3/projects/1fbd31910cc74f578370519a6827a490/users/cfb9d04f558642a4bf7e2fa37456f10e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:53.032450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:53.042107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d629884-ba64-4b58-a1b0-233ced7b62cb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:53.100397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:53.100987 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:53.101270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:53.101680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:53.102407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:53.104015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f869f-dd3c-4452-8c1e-fbc0c87af353 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:53.114938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 993/1982] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:53.119729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:53.130393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8cac2-f679-4a4c-a9f2-d45186163733 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:53.135551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:53.140096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:53.140096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:53.140096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] PATH_INFO: `/v3/projects/1fbd31910cc74f578370519a6827a490/users/cfb9d04f558642a4bf7e2fa37456f10e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:53.140096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbd31910cc74f578370519a6827a490, user_id=cfb9d04f558642a4bf7e2fa37456f10e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:53.142534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:53.154684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 990/1983] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:53 2022] PUT /identity/v3/projects/1fbd31910cc74f578370519a6827a490/users/cfb9d04f558642a4bf7e2fa37456f10e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:53.173092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:53.173385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:53.173663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:53.201252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] MFA Rules not processed for user `cfb9d04f558642a4bf7e2fa37456f10e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:53.202654 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:53.272621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 994/1984] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:53 2022] POST /identity/v3/auth/tokens => generated 3456 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:53.287467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:53.289441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:53.348718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2d89e-c96d-4569-8463-e925c6baa414 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:53.354080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:53.354080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:53.354080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:53.354080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:53.362983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:53.364555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f029c-d4e1-4621-bc8e-0e6575e8dbaa service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:53.374122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 991/1985] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:53 2022] GET /identity/v3/auth/tokens => generated 3456 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:56.086570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:56.166951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b964c2-5932-43b9-8228-ec0e435612f1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:56.173201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:56.174467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:56.174828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:56.175176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] PATH_INFO: `/v3/users/0f7e333c1a784e3dbf09327cabb5c717` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:56.176543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7e333c1a784e3dbf09327cabb5c717)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:56.183799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:56.428475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7e333c1a784e3dbf09327cabb5c717'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:56.429139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7e333c1a784e3dbf09327cabb5c717'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:56.436267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7e333c1a784e3dbf09327cabb5c717'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:56.512315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7e333c1a784e3dbf09327cabb5c717'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:56.527166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7e333c1a784e3dbf09327cabb5c717'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:56.534349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 995/1986] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:56 2022] DELETE /identity/v3/users/0f7e333c1a784e3dbf09327cabb5c717 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:56.538760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:56.539263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:56.539368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:56.558262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:56.559457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:56.634888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 992/1987] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:56.646129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:56.647535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:56.705726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcb80e-fbfb-42b8-bc27-7b2efedeeb83 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:56.709325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:56.709998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:56.710282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:56.710558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:56.720447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:56.721933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:56.732206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 996/1988] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:07:57.214301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:57.215757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:57.228891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb8cd-a526-4def-a5ab-465fc71cdc9d None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:57.234626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:57.235486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:57.235771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:57.236152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] PATH_INFO: `/v3/projects/74c9736aa6a846f8bd1b603790f8e081` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:57.237367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c9736aa6a846f8bd1b603790f8e081)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:57.239272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:57.371920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c9736aa6a846f8bd1b603790f8e081', 'request_id': 'req-38d89441-5596-4a18-a406-16069ccc505c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.377576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c9736aa6a846f8bd1b603790f8e081', 'request_id': 'req-38d89441-5596-4a18-a406-16069ccc505c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.455022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c9736aa6a846f8bd1b603790f8e081', 'request_id': 'req-38d89441-5596-4a18-a406-16069ccc505c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.467567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] The token cache is being invalidate because project 74c9736aa6a846f8bd1b603790f8e081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:57.467782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.468448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.469997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 993/1989] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:57 2022] DELETE /identity/v3/projects/74c9736aa6a846f8bd1b603790f8e081 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:57.474083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:57.490069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a31078-d5da-4899-b4e0-d390fbf18530 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:57.549926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:57.550786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:57.551064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:57.551332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] PATH_INFO: `/v3/users/cfb9d04f558642a4bf7e2fa37456f10e` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:57.552521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb9d04f558642a4bf7e2fa37456f10e)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:57.554408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:57.719770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb9d04f558642a4bf7e2fa37456f10e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.720344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb9d04f558642a4bf7e2fa37456f10e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.726843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb9d04f558642a4bf7e2fa37456f10e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.800177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb9d04f558642a4bf7e2fa37456f10e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.812913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-000ad99d-11bd-4aea-9c19-0cfa9f5bbde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb9d04f558642a4bf7e2fa37456f10e'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:57.818835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 997/1990] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:07:57 2022] DELETE /identity/v3/users/cfb9d04f558642a4bf7e2fa37456f10e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:58.244760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.246265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:58.261880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89441-5596-4a18-a406-16069ccc505c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.319698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.320582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.320865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.321137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] PATH_INFO: `/v3/projects/1fbd31910cc74f578370519a6827a490` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.322317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbd31910cc74f578370519a6827a490)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.324236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.417641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbd31910cc74f578370519a6827a490', 'request_id': 'req-f4381590-ccde-45ce-9847-752084918e78'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:58.423786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbd31910cc74f578370519a6827a490', 'request_id': 'req-f4381590-ccde-45ce-9847-752084918e78'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:58.474472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbd31910cc74f578370519a6827a490', 'request_id': 'req-f4381590-ccde-45ce-9847-752084918e78'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:58.485721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] The token cache is being invalidate because project 1fbd31910cc74f578370519a6827a490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:07:58.486002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:58.486616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f4381590-ccde-45ce-9847-752084918e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:07:58.491554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 994/1991] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:07:58 2022] DELETE /identity/v3/projects/1fbd31910cc74f578370519a6827a490 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:58.494173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.494633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.494721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.512313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:58.514182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:58.571314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 998/1992] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:58.579735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.581161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.581161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.605163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:58.606400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:58.614794 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 995/1993] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:58 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:58.619115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.629264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd8b63-72c2-4edc-bbb1-2ac00295a0f5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.633988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.634652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.634920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.635195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.635951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:07:58.636326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.638619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.650491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 999/1994] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:07:58.655365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.664550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7398b41-1660-4646-b456-7d748ca061d3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.669468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.670089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.670386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.670650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.671346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.673278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.782701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 996/1995] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:58 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:58.786543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.796766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce2d9-f650-4f0c-90e4-3f6baaadcc2b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.853096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.853756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.854073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.854346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.855041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.857504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.926755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1000/1996] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:58 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:58.930800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.941750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827dea8-2b9a-46c8-8587-6b3aae296d2c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.946522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.947170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.947455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.947726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.948519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.950091 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.962056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 997/1997] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:58.966138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:58.976307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c2c77-3f60-4586-b630-60ed7e7942f4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:58.981104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:58.981791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:58.982078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:58.982349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:58.983064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:58.984698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efef71-0ecb-4ea8-b988-52e2864642e2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:58.994465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1001/1998] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:07:58.999431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.009567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341aa29-d379-4199-a3fc-62d581044840 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.015071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.015936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.016255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.016530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] PATH_INFO: `/v3/projects/732f67e1f1634550a28173dd2b84c38c/users/59ee884b5495466b9490477b60a437df/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.031135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732f67e1f1634550a28173dd2b84c38c, user_id=59ee884b5495466b9490477b60a437df, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.033875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.105132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 998/1999] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:58 2022] PUT /identity/v3/projects/732f67e1f1634550a28173dd2b84c38c/users/59ee884b5495466b9490477b60a437df/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:59.113045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.113335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.113615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.144263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] MFA Rules not processed for user `59ee884b5495466b9490477b60a437df`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:59.146308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:59.216129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1002/2000] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:59 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:59.222181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.283325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec7f81-316f-4000-a989-cb224c423235 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.288120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.288715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.288996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.289295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.290192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.291990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.384237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 999/2001] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:07:59 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:07:59.388447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.399671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac87f0-cdfd-4162-aa6e-23448ffcb694 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.454113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.454776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.455089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.455389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.456112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.458151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.533130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1003/2002] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:07:59 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:07:59.537206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.549927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bae003-78f6-4e16-bf67-2fc9bfdf8def admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.554584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.555235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.555519 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.555796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.556612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.558213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.569360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1000/2003] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:59.573517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.584063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0c79-f351-4d9c-ad3d-f6b73c82af2d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.588890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.589759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.590040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.590316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] PATH_INFO: `/v3/projects/6b00d4c9cdff4801a01dfcefec149023/users/0f26621afd6e460190aac293944330b2/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.605030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b00d4c9cdff4801a01dfcefec149023, user_id=0f26621afd6e460190aac293944330b2, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.608061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.674890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1004/2004] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:59 2022] PUT /identity/v3/projects/6b00d4c9cdff4801a01dfcefec149023/users/0f26621afd6e460190aac293944330b2/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:59.678892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.692071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a033f-d935-433b-8980-d48a4c266a48 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.743791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.744478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.744764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.745036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.745752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.747322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfe4d0-d40e-4aea-8d26-6a6993572bcc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.757664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1001/2005] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:07:59.761855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.772647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84469c-1b9a-440c-a887-57fdaf7f58cc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.777370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.778237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.778520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.778796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] PATH_INFO: `/v3/projects/6b00d4c9cdff4801a01dfcefec149023/users/0f26621afd6e460190aac293944330b2/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.780961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b00d4c9cdff4801a01dfcefec149023, user_id=0f26621afd6e460190aac293944330b2, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.783686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:07:59.794166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1005/2006] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:07:59 2022] PUT /identity/v3/projects/6b00d4c9cdff4801a01dfcefec149023/users/0f26621afd6e460190aac293944330b2/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:07:59.804262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.804497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.804779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.831478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] MFA Rules not processed for user `0f26621afd6e460190aac293944330b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:07:59.832715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:59.898574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1002/2007] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:07:59 2022] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:07:59.908909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:07:59.910722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:07:59.979774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96fcaf-632e-45a7-ab32-6a9bb6a02966 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:07:59.984165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:07:59.988451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:07:59.988451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:07:59.988451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:07:59.995556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:07:59.997213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2f4ac-7736-4378-978d-9db5d043d931 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:00.023010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1006/2008] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:07:59 2022] GET /identity/v3/auth/tokens => generated 3468 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:00.617773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:00.701159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec4314-f740-4836-a1c2-91b8a086e9f4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:00.707003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:00.707868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:00.708183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:00.710134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] PATH_INFO: `/v3/users/59ee884b5495466b9490477b60a437df` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:00.710134 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ee884b5495466b9490477b60a437df)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:00.711814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:00.950569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ee884b5495466b9490477b60a437df'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:00.957776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ee884b5495466b9490477b60a437df'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:00.969669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ee884b5495466b9490477b60a437df'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.069053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ee884b5495466b9490477b60a437df'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.069677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ee884b5495466b9490477b60a437df'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.076302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1003/2009] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:00 2022] DELETE /identity/v3/users/59ee884b5495466b9490477b60a437df => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:01.081547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:01.082040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:01.082131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:01.099194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:01.100429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:01.160183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1007/2010] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:01.174247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:01.175674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:01.241312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560791-587d-4c9f-86ba-3b6176338614 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:01.246651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:01.247531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:01.247824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:01.248148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:01.257795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:01.259658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:01.269866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1004/2011] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:01.716580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:01.718843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:01.732119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7795-de15-426c-bd20-dc58149c9541 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:01.742259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:01.742259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:01.742259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:01.742259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] PATH_INFO: `/v3/projects/732f67e1f1634550a28173dd2b84c38c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:01.742845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=732f67e1f1634550a28173dd2b84c38c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:01.744106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:01.859487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732f67e1f1634550a28173dd2b84c38c', 'request_id': 'req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.865806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732f67e1f1634550a28173dd2b84c38c', 'request_id': 'req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.941102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732f67e1f1634550a28173dd2b84c38c', 'request_id': 'req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.953415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] The token cache is being invalidate because project 732f67e1f1634550a28173dd2b84c38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:01.953708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.954695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:01.957496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1008/2012] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:01 2022] DELETE /identity/v3/projects/732f67e1f1634550a28173dd2b84c38c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:01.961595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:01.971887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae623-589f-420e-8977-0a6eb6fc6490 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:02.035222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:02.039358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:02.039358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:02.039358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] PATH_INFO: `/v3/users/0f26621afd6e460190aac293944330b2` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:02.039358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f26621afd6e460190aac293944330b2)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:02.039907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:02.265335 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f26621afd6e460190aac293944330b2'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:02.272036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f26621afd6e460190aac293944330b2'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:02.283762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f26621afd6e460190aac293944330b2'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:02.363274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f26621afd6e460190aac293944330b2'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:02.363893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-48e32f32-447a-4a2f-86e0-3fff4a323347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f26621afd6e460190aac293944330b2'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:02.370778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1005/2013] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:01 2022] DELETE /identity/v3/users/0f26621afd6e460190aac293944330b2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:02.806065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:02.807947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:02.830585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1a04-3a26-4c21-8efb-1a3a591b2f6f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:02.909525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:02.910418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:02.910705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:02.911025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] PATH_INFO: `/v3/projects/6b00d4c9cdff4801a01dfcefec149023` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:02.912296 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b00d4c9cdff4801a01dfcefec149023)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:02.914320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.052313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b00d4c9cdff4801a01dfcefec149023', 'request_id': 'req-624409d4-e48a-4cf9-b21c-79415ba539ca'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:03.058635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b00d4c9cdff4801a01dfcefec149023', 'request_id': 'req-624409d4-e48a-4cf9-b21c-79415ba539ca'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:03.118770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b00d4c9cdff4801a01dfcefec149023', 'request_id': 'req-624409d4-e48a-4cf9-b21c-79415ba539ca'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:03.134124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] The token cache is being invalidate because project 6b00d4c9cdff4801a01dfcefec149023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:03.134678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:03.135602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:03.147353 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1009/2014] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:02 2022] DELETE /identity/v3/projects/6b00d4c9cdff4801a01dfcefec149023 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:03.153267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284131-36c5-46ed-be6e-a24a3321bd72 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.153661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284131-36c5-46ed-be6e-a24a3321bd72 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.153858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284131-36c5-46ed-be6e-a24a3321bd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.177979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-37284131-36c5-46ed-be6e-a24a3321bd72 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:03.179547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-37284131-36c5-46ed-be6e-a24a3321bd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:03.216427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.219146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:03.257872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1006/2015] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:03.259683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.259999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.260329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.282274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:03.284272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:03.301302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1007/2016] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:03.305445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.319939 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3071dc-6520-4ea0-9ca2-fe367e1cc330 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.322386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.323228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.323904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.324373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.325111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:03.325417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.327741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.353906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624409d4-e48a-4cf9-b21c-79415ba539ca admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.358699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.359359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.359642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.359916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.361768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:03.363904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1008/2017] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:03.370081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.388337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ec4ad-daf8-4d31-8ce6-8b243b1f2a39 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.393812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.394476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.394762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.395037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.395729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.397712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.435814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.438189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.448947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1010/2018] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:03 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:08:03.493936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1009/2019] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:03 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:03.498219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.515099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e03837-db02-4c84-917a-6503c060cd08 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.615625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.616361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.616650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.616930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.619405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.619702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.709032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1011/2020] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:03 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:08:03.713738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.730986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8db52e-b183-496f-9d06-3c70cb5dffee admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.736210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.737147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.737529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.737871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.738695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.740340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.752300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1010/2021] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:03.756188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.766635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dee67-69d5-4391-bea8-52abd2a8a936 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.773291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.774468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.774468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.774712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.775438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.777111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaf18d-4ecb-43c2-8a12-12f7000ba205 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.788496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1012/2022] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:03.792884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:03.802868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c6c2a-410f-4220-b084-9387f20f038b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:03.814455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:03.815360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.815650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.821004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] PATH_INFO: `/v3/projects/6ffd4e9c692b4f128b966f375eb5f7a0/users/e2e710566b394199b3478e73af4d17d0/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.835952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffd4e9c692b4f128b966f375eb5f7a0, user_id=e2e710566b394199b3478e73af4d17d0, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:03.839404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:03.957406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1011/2023] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:03 2022] PUT /identity/v3/projects/6ffd4e9c692b4f128b966f375eb5f7a0/users/e2e710566b394199b3478e73af4d17d0/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:03.967853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:03.968711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:03.968711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:03.995567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] MFA Rules not processed for user `e2e710566b394199b3478e73af4d17d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:03.997027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:04.081796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1013/2024] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:03 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:04.147634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:04.149527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:04.212132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d421c-fbb8-406e-8f5a-d8daa8d95fbf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:04.219284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:04.219946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:04.220400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:04.220681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:04.229785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:04.231235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd39b11-1a7e-45c9-b144-43f89e30e476 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:04.241471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1012/2025] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:04 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:04.261056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:04.343026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab6bd8-7a0b-49d5-90da-b5c72ba195a9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:04.347863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:04.348965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:04.349323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:04.349677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] PATH_INFO: `/v3/users/e2e710566b394199b3478e73af4d17d0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:04.352025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e710566b394199b3478e73af4d17d0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:04.353097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:04.575381 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e710566b394199b3478e73af4d17d0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:04.576052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e710566b394199b3478e73af4d17d0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:04.582833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e710566b394199b3478e73af4d17d0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:04.638228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e710566b394199b3478e73af4d17d0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:04.650580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e710566b394199b3478e73af4d17d0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:04.656478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1014/2026] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:04 2022] DELETE /identity/v3/users/e2e710566b394199b3478e73af4d17d0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:04.661023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:04.661315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:04.661597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:04.679422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:04.680811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:04.741046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1013/2027] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:04 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:04.751704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:04.753205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:04.811941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e701bd-527e-44d1-91f8-4f6291bd3706 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:04.815566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:04.817579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:04.817579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:04.817579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:04.825678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:04.827195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1afc5-bac5-42c6-896b-e614f3d4df4d service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:04.836372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1015/2028] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:04 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:05.319614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:05.323050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.346157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538eb18-0c9d-4073-bef2-d79f1a2acdf8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:05.360171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:05.360964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.360964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.361135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] PATH_INFO: `/v3/projects/6ffd4e9c692b4f128b966f375eb5f7a0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.362372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffd4e9c692b4f128b966f375eb5f7a0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:05.364291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:05.524666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffd4e9c692b4f128b966f375eb5f7a0', 'request_id': 'req-73f1241f-7d05-4a07-a657-a613d2b0e854'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:05.532080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffd4e9c692b4f128b966f375eb5f7a0', 'request_id': 'req-73f1241f-7d05-4a07-a657-a613d2b0e854'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:05.641908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffd4e9c692b4f128b966f375eb5f7a0', 'request_id': 'req-73f1241f-7d05-4a07-a657-a613d2b0e854'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:05.665988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] The token cache is being invalidate because project 6ffd4e9c692b4f128b966f375eb5f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:05.666647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:05.667598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-73f1241f-7d05-4a07-a657-a613d2b0e854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:05.676579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1014/2029] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:05 2022] DELETE /identity/v3/projects/6ffd4e9c692b4f128b966f375eb5f7a0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:05.678191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadd71-0954-4c70-914f-7f1c8fe6f76c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.678656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadd71-0954-4c70-914f-7f1c8fe6f76c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.678938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadd71-0954-4c70-914f-7f1c8fe6f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.706522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6ccadd71-0954-4c70-914f-7f1c8fe6f76c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:05.708040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6ccadd71-0954-4c70-914f-7f1c8fe6f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.735275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.735554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.735838 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.760167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:05.761502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.784664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1016/2030] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:05.792300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.792587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.792861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.811002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:05.813095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.821332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1015/2031] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:08:05 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:05.824584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1017/2032] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:05.825599 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:05.847023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f225ba9-50e5-43e4-84c5-ccb06ddd7c9b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:05.872463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:05.873135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.873419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.873717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.873848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:05.874589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:05.874973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:05.875265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:05.877283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:05.890769 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1016/2033] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:05.907492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:05.922196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891f290-2c51-431b-9ab4-498dcafde9b1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:05.928819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:05.929476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.929761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.930136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.931050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:05.933138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:05.957423 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620c7ce-b717-43bc-8699-251fa81df501 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:05.962729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:05.963374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:05.963660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:05.963940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:05.973079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:05.974702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:05.982802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1018/2034] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:08:06.084481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1017/2035] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:05 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:06.089217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:06.100244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e571abb-dae1-4b2e-96fa-4a75a9e1d3c5 service swift] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:06.176179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:06.176412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.176787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.177177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.177973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:06.180293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:06.307134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1019/2036] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:06 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:08:06.311233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:06.321579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81517a4d-e549-4eba-920d-9c5a763e7856 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:06.326495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:06.327314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.327682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.327962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.328718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:06.330303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:06.340521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1018/2037] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:06.345623 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:06.356805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af05e9-ec15-4d53-a227-c0b7c9bdcb77 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:06.362563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:06.363229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.363518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.363800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.364594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:06.366214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7f3d5-2216-496a-9da8-87c4561ed610 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:06.377460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1020/2038] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:06.381647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:06.395703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d58bb-04bc-4dd6-b502-104d5c5b83b1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:06.400364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:06.401238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.401515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.401790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] PATH_INFO: `/v3/projects/daec5691753140169f811110e7be2eba/users/c8939aee610f4091baa8a0147c6b1681/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.417499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daec5691753140169f811110e7be2eba, user_id=c8939aee610f4091baa8a0147c6b1681, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:06.420228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:06.537865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1019/2039] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:06 2022] PUT /identity/v3/projects/daec5691753140169f811110e7be2eba/users/c8939aee610f4091baa8a0147c6b1681/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:06.548399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53115c1-c58f-4808-b451-89d10ca9da10 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.548715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53115c1-c58f-4808-b451-89d10ca9da10 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.549005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53115c1-c58f-4808-b451-89d10ca9da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.575123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d53115c1-c58f-4808-b451-89d10ca9da10 None None] MFA Rules not processed for user `c8939aee610f4091baa8a0147c6b1681`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:06.576307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d53115c1-c58f-4808-b451-89d10ca9da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:06.650715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1021/2040] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:06 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:06.661043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:06.662718 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:06.726388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc84ac-38f4-4385-ba87-e15462c924a0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:06.730514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:06.731164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:06.731448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:06.731840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:06.741096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:06.742474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:06.751877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1020/2041] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:06 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:07.009355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b125d5-12bd-48a7-b020-46fff9ce893d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:07.009846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b125d5-12bd-48a7-b020-46fff9ce893d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:07.009940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b125d5-12bd-48a7-b020-46fff9ce893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:07.028081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-66b125d5-12bd-48a7-b020-46fff9ce893d None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:07.029253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-66b125d5-12bd-48a7-b020-46fff9ce893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:07.084548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1022/2042] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:08:07 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:07.099953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:07.168278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356a00-c75a-4d2f-9845-943717c29255 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:07.175146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:07.175787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:07.176108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:07.176385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:07.184737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:07.186982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:07.195345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1021/2043] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:07.831411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f6db-ad47-4b26-ad4c-d1f5fe17c2f0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:07.831708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f6db-ad47-4b26-ad4c-d1f5fe17c2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:07.832001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f6db-ad47-4b26-ad4c-d1f5fe17c2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:07.861133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-30e3f6db-ad47-4b26-ad4c-d1f5fe17c2f0 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:07.862324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-30e3f6db-ad47-4b26-ad4c-d1f5fe17c2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:07.869880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1023/2044] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:08:07 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:07.882840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:07.893603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec8804-994c-40db-92fb-bf3c226af79f service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:07.898832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:07.899462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:07.899743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:07.900047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:07.908961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:07.910514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:07.918612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1022/2045] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:08:08.564972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886141-10e6-4978-9afd-6a54123cbf22 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:08.565549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886141-10e6-4978-9afd-6a54123cbf22 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:08.565549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886141-10e6-4978-9afd-6a54123cbf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:08.584204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e0886141-10e6-4978-9afd-6a54123cbf22 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:08.585404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e0886141-10e6-4978-9afd-6a54123cbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:08.593622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1024/2046] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:08:08 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:08.606613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:08.618064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd508b-59ae-4a72-9b02-5a30dc3c9348 service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:08.623366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:08.624132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:08.624559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:08.624886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:08.634010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:08.635687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:08.645262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1023/2047] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:11.644297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:11.644778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:11.644869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:11.662306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] MFA Rules not processed for user `b019715a14074e059730965913694e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:11.663484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:11.720625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1025/2048] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:11 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:15.934405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:15.936066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.003549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfd6e2-21aa-40d1-b954-0931bf6dffc9 service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:16.009408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:16.010299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.010577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.010867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] PATH_INFO: `/v3/users/c91b9fabc9074cc4b743a47d973ad8e8` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.012588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91b9fabc9074cc4b743a47d973ad8e8)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:16.015166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:16.305985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91b9fabc9074cc4b743a47d973ad8e8'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.315662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91b9fabc9074cc4b743a47d973ad8e8'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.331171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91b9fabc9074cc4b743a47d973ad8e8'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.402882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:16.409625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.423265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede177-29c8-49e9-95b1-13a3af82f08f None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:16.428469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:16.429385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.429668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.429952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] PATH_INFO: `/v3/users/bd5d9ed0db1e4efcad0dfddb7291c658` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.431488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5d9ed0db1e4efcad0dfddb7291c658)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:16.433525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:16.467319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91b9fabc9074cc4b743a47d973ad8e8'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.467614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b5c8cfbe-c6b2-4c0e-9c22-7f910bbb106d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91b9fabc9074cc4b743a47d973ad8e8'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.482749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1024/2049] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:15 2022] DELETE /identity/v3/users/c91b9fabc9074cc4b743a47d973ad8e8 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:16.485428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.485969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.486098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.508322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:16.509730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.580717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1025/2050] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:16.590914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:16.593772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.640372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5d9ed0db1e4efcad0dfddb7291c658'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.641146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5d9ed0db1e4efcad0dfddb7291c658'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.648729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5d9ed0db1e4efcad0dfddb7291c658'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.668968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1560e-37a8-4b0b-802c-f88b8933c857 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:16.674050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:16.674702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.674980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.675257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.685166 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:16.687664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992329-ecd8-4c87-8649-447442ff4f58 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:16.698617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1026/2051] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:08:16.714978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5d9ed0db1e4efcad0dfddb7291c658'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.731846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5d9ed0db1e4efcad0dfddb7291c658'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:16.739443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1026/2052] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:16 2022] DELETE /identity/v3/users/bd5d9ed0db1e4efcad0dfddb7291c658 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:16.744399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.744622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.745046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.762610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:16.763906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.829907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1027/2053] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:16.841386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:16.843786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:16.932474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c20b3-9889-4f9b-84d6-210f5e63c4c2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:16.937857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:16.938583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:16.938867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:16.939477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:16.956769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:16.958544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:16.971138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1027/2054] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:17.268795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.270674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.297438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f484ed-6ae6-4f52-98b7-d87f5eb7e581 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.304767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.305980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.306257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.307513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] PATH_INFO: `/v3/projects/328131fd3ad64205a4928d00c2bb8c23` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.309596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328131fd3ad64205a4928d00c2bb8c23)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.313202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:17.444534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328131fd3ad64205a4928d00c2bb8c23', 'request_id': 'req-dad96444-e60e-4adc-8b2c-b1beed3abff3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.450808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328131fd3ad64205a4928d00c2bb8c23', 'request_id': 'req-dad96444-e60e-4adc-8b2c-b1beed3abff3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.459793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.461300 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.487645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e1589-b38e-4f76-a4b3-460660bdcff0 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.530682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328131fd3ad64205a4928d00c2bb8c23', 'request_id': 'req-dad96444-e60e-4adc-8b2c-b1beed3abff3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.546386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] The token cache is being invalidate because project 328131fd3ad64205a4928d00c2bb8c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:17.546868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.548174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dad96444-e60e-4adc-8b2c-b1beed3abff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.550698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1028/2055] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:17 2022] DELETE /identity/v3/projects/328131fd3ad64205a4928d00c2bb8c23 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:17.559418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.561712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.562308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.562506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59861cb-7fda-4e0c-9f98-17bdc9c13a83 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.562641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] PATH_INFO: `/v3/projects/b3bbb70fe0f54bfcb551a568f070410c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.563062 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59861cb-7fda-4e0c-9f98-17bdc9c13a83 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.563494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59861cb-7fda-4e0c-9f98-17bdc9c13a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.564186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bbb70fe0f54bfcb551a568f070410c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.566370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:17.598955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f59861cb-7fda-4e0c-9f98-17bdc9c13a83 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:17.600300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f59861cb-7fda-4e0c-9f98-17bdc9c13a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.610358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1029/2056] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:17.617793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.618076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.618348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.636981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:17.638314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.648151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1030/2057] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:17.661361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.672444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe2b7-1fce-4822-86b6-d283b3ff1ec8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.677573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.678428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.678867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.679127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.679856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:17.680199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.682302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:17.696558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1031/2058] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:17.700606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.706559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bbb70fe0f54bfcb551a568f070410c', 'request_id': 'req-0cb31c91-8a34-4387-8edd-418cd8760a6c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.711905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ec261-aa4e-4081-a892-567530dafa97 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.712981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bbb70fe0f54bfcb551a568f070410c', 'request_id': 'req-0cb31c91-8a34-4387-8edd-418cd8760a6c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.772924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.772924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.772924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.773299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.773841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.775762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:17.826518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bbb70fe0f54bfcb551a568f070410c', 'request_id': 'req-0cb31c91-8a34-4387-8edd-418cd8760a6c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.837882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] The token cache is being invalidate because project b3bbb70fe0f54bfcb551a568f070410c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:17.838172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.838996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:17.841123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1028/2059] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:17 2022] DELETE /identity/v3/projects/b3bbb70fe0f54bfcb551a568f070410c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:17.845059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.846150 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.864313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31c91-8a34-4387-8edd-418cd8760a6c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.868311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1032/2060] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:17 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:08:17.872568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:17.872833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.873833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.874594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.874875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] PATH_INFO: `/v3/users/0c6c9d7ce5484727b29d366e83dcc303` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.875037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:17.876260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6c9d7ce5484727b29d366e83dcc303)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.879156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:17.939739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85ecda-01f0-49e1-afd1-b44f8124a642 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:17.944662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:17.945321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:17.945680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:17.945916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:17.946694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:17.948818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.059400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1033/2061] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:17 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:08:18.065608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:18.082734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6c9d7ce5484727b29d366e83dcc303'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.083900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6c9d7ce5484727b29d366e83dcc303'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.084827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9533-fb4f-473e-9cb4-31ac032beca1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:18.093598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:18.094395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.094681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.094961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.095687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:18.097319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.097975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6c9d7ce5484727b29d366e83dcc303'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.107726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1034/2062] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:18.111459 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:18.121168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73da721-0cb0-4dd3-a053-84e57aaf52cd admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:18.126700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:18.127557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.128195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.128473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.129202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:18.131002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.145286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1035/2063] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:18.149334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:18.159265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55823f6-1f5d-438c-8612-c8a5eaf4455a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:18.164088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:18.164969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.168650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.168650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] PATH_INFO: `/v3/projects/2e991e35dc5b463fbf9f08db0e72cf46/users/14f6f890deb74eadab6b1ff4b6431036/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.180260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e991e35dc5b463fbf9f08db0e72cf46, user_id=14f6f890deb74eadab6b1ff4b6431036, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:18.182977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.183213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6c9d7ce5484727b29d366e83dcc303'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.196577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06c13fcf-dfbd-4bc2-8c08-1030518972d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6c9d7ce5484727b29d366e83dcc303'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.203448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1029/2064] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:17 2022] DELETE /identity/v3/users/0c6c9d7ce5484727b29d366e83dcc303 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:18.356658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1036/2065] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:18 2022] PUT /identity/v3/projects/2e991e35dc5b463fbf9f08db0e72cf46/users/14f6f890deb74eadab6b1ff4b6431036/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:18.359856 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.360160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.360466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.385251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:18.387340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:18.463119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1030/2066] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:18.478030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:18.480622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:18.550775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed50f8-9448-4c8f-82c6-4640f3b1bb4d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:18.554886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:18.555577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.555864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.556175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.567071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:18.570543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9764-99df-4bc4-a60f-7a2ab90f2290 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.579632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1037/2067] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:18 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:08:18.619584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:18.626563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:18.643355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b588-6b6b-4a18-96aa-6440764a28ac None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:18.667914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:18.668883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.669342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.670188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] PATH_INFO: `/v3/projects/0befcf08e33642a3978688628be9a933` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.671108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0befcf08e33642a3978688628be9a933)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:18.673865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:18.827756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0befcf08e33642a3978688628be9a933', 'request_id': 'req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.837317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0befcf08e33642a3978688628be9a933', 'request_id': 'req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.929375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0befcf08e33642a3978688628be9a933', 'request_id': 'req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.941965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] The token cache is being invalidate because project 0befcf08e33642a3978688628be9a933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:18.942485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.943323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-94e762c4-5f6c-46cc-91c0-7a10236e3c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:18.945516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1031/2068] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:18 2022] DELETE /identity/v3/projects/0befcf08e33642a3978688628be9a933 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:18.952767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:18.953170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:18.953517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:18.974471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:18.976047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:19.090568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1038/2069] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:18 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:19.100034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.100034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.100434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.126439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:19.126439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:19.146621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1032/2070] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:19.147336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.161163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3d4e2-3039-4388-aed1-e0f4a3ed6f90 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.168139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.169415 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.169784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.170485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.172173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:19.172960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.175281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.192188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1039/2071] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:08:19.200004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.212222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e0597-838e-4cea-b588-7bd6c7e1ddfa None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.221725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.226832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.227449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.227449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.228648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.232078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.352778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1033/2072] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:19 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:19.357200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.369582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01b208-7607-4246-95fc-fe7496718627 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.440115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.440790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.441071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.441344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.442074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.445164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.552038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1040/2073] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:19 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:08:19.554491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.570023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c31262-f6c2-4cfc-a931-a98f45428d54 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.574691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.575339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.575618 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.575898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.577535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.579316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.590493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1034/2074] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:19.595731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.605744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7717-c636-4449-85fb-6faac8c83a04 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.610878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.611545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.611829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.612144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.613020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.614693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.634108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1041/2075] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:19.635331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.646507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e87379-d853-410c-ad89-0a46e13912ba admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.651760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.656000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.656000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.656000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] PATH_INFO: `/v3/projects/f796bb1602a7400cb10d9572440e4b07/users/2ec7322bb6834cf5be269b49ba966fb9/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.672503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f796bb1602a7400cb10d9572440e4b07, user_id=2ec7322bb6834cf5be269b49ba966fb9, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.675646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de06d4-4dbc-46ef-bb9a-a0af580b5900 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:19.788097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1035/2076] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:19 2022] PUT /identity/v3/projects/f796bb1602a7400cb10d9572440e4b07/users/2ec7322bb6834cf5be269b49ba966fb9/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:19.788418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:19.788418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:19.793135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.793425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.793703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.803603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda36ec-d854-4179-875b-02334f79840d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:19.870204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] MFA Rules not processed for user `2ec7322bb6834cf5be269b49ba966fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:19.871463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:19.961672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:19.961672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:19.961672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:19.961672 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] PATH_INFO: `/v3/users/c8939aee610f4091baa8a0147c6b1681` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:19.962733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8939aee610f4091baa8a0147c6b1681)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:19.962733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.003061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1036/2077] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:19 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:20.014630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:20.017908 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:20.078473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3331e3a-30e8-4ff5-8ffa-31a63adea06a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:20.082132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:20.082770 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.083055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.083332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.093260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:20.093790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.103178 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1037/2078] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:20 2022] GET /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:08:20.130364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:20.147909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5e1b3-2ca8-43ad-8328-d2c5b3ed4af1 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:20.153010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:20.154251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.154531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.154846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] PATH_INFO: `/v3/users/2ec7322bb6834cf5be269b49ba966fb9` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.160850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec7322bb6834cf5be269b49ba966fb9)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:20.163536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.337730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8939aee610f4091baa8a0147c6b1681'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.348489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8939aee610f4091baa8a0147c6b1681'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.361594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8939aee610f4091baa8a0147c6b1681'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.405590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec7322bb6834cf5be269b49ba966fb9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.406270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec7322bb6834cf5be269b49ba966fb9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.413377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec7322bb6834cf5be269b49ba966fb9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.463400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8939aee610f4091baa8a0147c6b1681'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.464033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8939aee610f4091baa8a0147c6b1681'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.472099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1042/2079] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:19 2022] DELETE /identity/v3/users/c8939aee610f4091baa8a0147c6b1681 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:20.474981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:20.474981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:20.524111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec7322bb6834cf5be269b49ba966fb9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.544857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638866c-f984-4dab-a422-81631e86bd27 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:20.547172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8c78b89d-f4d8-44ed-ba69-3006a119a6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec7322bb6834cf5be269b49ba966fb9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.555166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1038/2080] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:20 2022] DELETE /identity/v3/users/2ec7322bb6834cf5be269b49ba966fb9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:20.557354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb142-2422-450e-947d-f11ae5e5f6f1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.557899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb142-2422-450e-947d-f11ae5e5f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.558260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:20.558521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb142-2422-450e-947d-f11ae5e5f6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.559155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.559495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.559778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] PATH_INFO: `/v3/users/89e008771b9a4c24b879466a755a3870` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.561279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e008771b9a4c24b879466a755a3870)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:20.563758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.585102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9d5fb142-2422-450e-947d-f11ae5e5f6f1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:20.586325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9d5fb142-2422-450e-947d-f11ae5e5f6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:20.653205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1039/2081] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:20.653205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.653205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.653205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.672284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:20.673528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:20.684548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1040/2082] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:20.684548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:20.684548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:20.750629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbef50-8c5b-4691-a7de-5532ad8cc721 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:20.754485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:20.755211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.755633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.757093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.768680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:20.770558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.781440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1041/2083] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:20.783343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:20.813682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472e3c4-fc51-4c03-bfec-404e66d4ec07 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:20.818612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:20.819450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.819873 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e008771b9a4c24b879466a755a3870'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.820064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.820271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.830078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e008771b9a4c24b879466a755a3870'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.831269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:20.832927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827201e4-b7c2-42cc-9ba3-8a813b2cf845 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:20.844044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1042/2084] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:20 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:20.845493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e008771b9a4c24b879466a755a3870'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.910349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e008771b9a4c24b879466a755a3870'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.911324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e008771b9a4c24b879466a755a3870'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:20.925308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1043/2085] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:20 2022] DELETE /identity/v3/users/89e008771b9a4c24b879466a755a3870 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:20.925554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:20.925847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:20.926128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:20.949706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:20.951037 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:21.093021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1043/2086] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:20 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:21.129179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:21.131052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:21.268558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4686ab-acf2-467d-8936-7bfd53061238 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:21.273202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:21.273846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:21.274241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:21.274730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:21.290747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:21.296499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:21.307389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1044/2087] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:21 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:21.626793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:21.628366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:21.648272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09d0e-180e-402a-a411-33c11e0feb7b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:21.665200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:21.667732 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:21.668045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:21.668485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] PATH_INFO: `/v3/projects/daec5691753140169f811110e7be2eba` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:21.699831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daec5691753140169f811110e7be2eba)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:21.704062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:21.731553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:21.734851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:21.760861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01343383-9780-4612-9db6-69f7b9b62c33 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:21.767802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:21.788279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:21.789584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:21.790962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] PATH_INFO: `/v3/projects/f796bb1602a7400cb10d9572440e4b07` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:21.794259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f796bb1602a7400cb10d9572440e4b07)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:21.796836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:21.896036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daec5691753140169f811110e7be2eba', 'request_id': 'req-e1178301-9495-43b7-a770-61f18d6c9836'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:21.911802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daec5691753140169f811110e7be2eba', 'request_id': 'req-e1178301-9495-43b7-a770-61f18d6c9836'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:21.949440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f796bb1602a7400cb10d9572440e4b07', 'request_id': 'req-aa549a2e-2b67-4048-b044-122a471ce852'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:21.956651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f796bb1602a7400cb10d9572440e4b07', 'request_id': 'req-aa549a2e-2b67-4048-b044-122a471ce852'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.003894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daec5691753140169f811110e7be2eba', 'request_id': 'req-e1178301-9495-43b7-a770-61f18d6c9836'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.016752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] The token cache is being invalidate because project daec5691753140169f811110e7be2eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:22.017122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.017980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e1178301-9495-43b7-a770-61f18d6c9836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.019759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1044/2088] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:21 2022] DELETE /identity/v3/projects/daec5691753140169f811110e7be2eba => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:22.025794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.026082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.026361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.046032 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.047392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.099630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f796bb1602a7400cb10d9572440e4b07', 'request_id': 'req-aa549a2e-2b67-4048-b044-122a471ce852'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.117583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1045/2089] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:22.119882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.132375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] The token cache is being invalidate because project f796bb1602a7400cb10d9572440e4b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:22.134442 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.135113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.145007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-aa549a2e-2b67-4048-b044-122a471ce852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.152023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1045/2090] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:21 2022] DELETE /identity/v3/projects/f796bb1602a7400cb10d9572440e4b07 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:22.155691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee379-3fbf-450e-9ad6-cb28c0dc0229 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.155910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee379-3fbf-450e-9ad6-cb28c0dc0229 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.156128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee379-3fbf-450e-9ad6-cb28c0dc0229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.169310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bf8b-d929-4cf0-97ab-c75149d2ac63 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.179399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.180632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.180911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.181196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] PATH_INFO: `/v3/projects/38716ffbfde64622b70c6c1a5b660fa8` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.182905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38716ffbfde64622b70c6c1a5b660fa8)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.184445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.188837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4d5ee379-3fbf-450e-9ad6-cb28c0dc0229 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.190289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4d5ee379-3fbf-450e-9ad6-cb28c0dc0229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.199486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1046/2091] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:22.201069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.201506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.202860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.237221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.238628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.256302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1047/2092] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:22.257737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.269092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecc60-05cb-410d-8617-ec1bb7c134cb None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.281919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.282695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.283083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.284467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.285342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:22.285756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.290401 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbda41-d289-41e7-b2d6-c21573833456 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.320214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1048/2093] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:22.322556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68914a-0d17-460a-a28c-d438e84847d3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.323292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68914a-0d17-460a-a28c-d438e84847d3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.323682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68914a-0d17-460a-a28c-d438e84847d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.334675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38716ffbfde64622b70c6c1a5b660fa8', 'request_id': 'req-47f90a9f-9598-40e1-aa8e-2b9f1312091d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.347180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38716ffbfde64622b70c6c1a5b660fa8', 'request_id': 'req-47f90a9f-9598-40e1-aa8e-2b9f1312091d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.353556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-6a68914a-0d17-460a-a28c-d438e84847d3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.354662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6a68914a-0d17-460a-a28c-d438e84847d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.438727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38716ffbfde64622b70c6c1a5b660fa8', 'request_id': 'req-47f90a9f-9598-40e1-aa8e-2b9f1312091d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.459131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] The token cache is being invalidate because project 38716ffbfde64622b70c6c1a5b660fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:22.459695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.461561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:22.464279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1046/2094] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:22 2022] DELETE /identity/v3/projects/38716ffbfde64622b70c6c1a5b660fa8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:22.465211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.470313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.481396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1049/2095] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:22.481396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.481396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.481396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.493191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a9f-9598-40e1-aa8e-2b9f1312091d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.507642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.508827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.517176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.517907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.518136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.518474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.519544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.521510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.528397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1050/2096] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:22.528397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.534261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bef15-7ad9-498e-9058-ad41ef86f58f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.540090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.541191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.541573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.542041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.555837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:22.555837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.555837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59672b4-a8ba-455d-a5a0-77c5c46feabc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.579733 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1051/2097] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:22.581974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.582267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.582545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.610481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:22.612252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:22.624563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1052/2098] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:22.624563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.634716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f273ea-0c73-4f58-97db-60e5695bf11b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.641061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.642947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.643259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.643673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.644444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.646363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.676343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1047/2099] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/projects => generated 359 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:22.678246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.763382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25aa0d-07a3-421a-b68e-43b9e059f4b4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.769132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.769790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.770080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.770356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.771086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:22.771396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.774238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.789099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1048/2100] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:22.791117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.820924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6057c-87fb-4cb0-8296-b9bbefd2743b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.821573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1053/2101] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:22.822557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:22.926887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.928187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.928653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.931264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.943779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.947826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:22.985967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa332d7e-5f58-4a5d-b185-459c0a82de3e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:22.992950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:22.996791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:22.996791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:22.996791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:22.996791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:22.998032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.052900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1049/2102] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/users => generated 280 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:23.054301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.067878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f09f7-b6e1-4f1d-8cc6-f114093dca28 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.076616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.077491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.077782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.078068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.096322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.096322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.112036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1054/2103] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:22 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:23.112800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.193612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1050/2104] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:23 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:23.194563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.205575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eda94-23b9-4fd0-a695-61c83e5735a5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.206077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fdee-42c1-411b-a253-07ecbc4d5db5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.211228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.211999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.212685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.212685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.213345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.215403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.215732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.216867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.218077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.219052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.220449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.223558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.237111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1055/2105] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.238279 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.249357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0391912-4a16-4e69-acb9-f4acbb7efe90 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.255243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.256087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.256467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.256864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.257807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.260639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.272889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1056/2106] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.273887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.322985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac46d-9762-48a1-9f41-f4ae312488ae admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.332384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1051/2107] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:23 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:23.332384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.334937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.336402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.336782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.338238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.339086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.343164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.344367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f58e6b-0bfc-41fd-9ad1-70d5a235ac4c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.349587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.351028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.351340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.351636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.352386 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.354336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.369286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1057/2108] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.372108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.395043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1052/2109] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.396798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.400520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f58ebd-ceb8-4f82-9499-cba3697ec147 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.407001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.408195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.408578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.408955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.413417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.413417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.419354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a82beb-4f21-4b3d-a037-883c4e58ef8e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.425968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.426884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.427165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.428530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] PATH_INFO: `/v3/projects/913336e737274ac78c4dea854abb8cf4/users/26eb837d21c64b6ea1bf6c886c0376d5/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.450418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=913336e737274ac78c4dea854abb8cf4, user_id=26eb837d21c64b6ea1bf6c886c0376d5, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.455004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.458353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1058/2110] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.461336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.486623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c530-686d-4000-95cf-895887747e84 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.500267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.503185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.503185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.503185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] PATH_INFO: `/v3/projects/03cbb76e2f2e4f4db8e0184d378c6311/users/a1ba4800c9444f80941afddd9082243d/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.539198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cbb76e2f2e4f4db8e0184d378c6311, user_id=a1ba4800c9444f80941afddd9082243d, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.545188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1172d-f739-4558-921b-52d3dd271bc2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.567880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1053/2111] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:23 2022] PUT /identity/v3/projects/913336e737274ac78c4dea854abb8cf4/users/26eb837d21c64b6ea1bf6c886c0376d5/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:23.567880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.668151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1059/2112] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:23 2022] PUT /identity/v3/projects/03cbb76e2f2e4f4db8e0184d378c6311/users/a1ba4800c9444f80941afddd9082243d/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:23.669877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.670959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.671613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.702206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e20b6a-3ff4-4053-8959-ade0589cde2a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.759670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] MFA Rules not processed for user `26eb837d21c64b6ea1bf6c886c0376d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:23.760955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:23.816391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.817667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.824512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.824512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.824512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.824512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1646148-2ea5-448d-88e1-3d3e2bebc288 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.837785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1054/2113] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:23.839791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.840267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.840693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.882675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] MFA Rules not processed for user `a1ba4800c9444f80941afddd9082243d`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:23.884563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:23.917085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1060/2114] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:23 2022] POST /identity/v3/auth/tokens => generated 3379 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:23.924669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.950768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2b8e8-f857-4c7b-8553-e751a24f7dc2 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:23.959026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:23.959686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:23.959998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:23.960278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] PATH_INFO: `/v3/projects/26675948923040c28f4bd83bdc934495/users/a686a490e3c142bcb8b08cb2ea2c546a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:23.980590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26675948923040c28f4bd83bdc934495, user_id=a686a490e3c142bcb8b08cb2ea2c546a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:23.983990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:23.993182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1055/2115] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:23 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:23.994265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:23.995793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:24.067617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1061/2116] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:23 2022] PUT /identity/v3/projects/26675948923040c28f4bd83bdc934495/users/a686a490e3c142bcb8b08cb2ea2c546a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:24.068674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:24.080187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553486e1-210a-47f4-99c0-e88fed34091d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:24.180994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:24.181674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.181961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.182240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.271600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:24.273789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321434-ef20-4fa9-9f50-09643391defa service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:24.286614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1056/2117] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:23 2022] GET /identity/v3/auth/tokens => generated 3379 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:24.290741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.290741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.290741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.330460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] MFA Rules not processed for user `a686a490e3c142bcb8b08cb2ea2c546a`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:24.333040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:24.366105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb6fd3-a0b4-48f4-88e3-ace06ee3fee5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:24.394344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:24.394344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.394344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.394344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.394719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:24.394719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:24.499572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1057/2118] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:24 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:24.500653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:24.517816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1062/2119] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:24 2022] POST /identity/v3/projects => generated 375 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:24.517816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:24.524147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57667df-65c2-414f-811c-1e93f2f5cf02 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:24.529095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:24.607662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8759-084d-4830-8c6c-87190911365f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:24.612486 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:24.613280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.613565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.613841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.689188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:24.690812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:24.703950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1063/2120] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:24 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:24.705086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:24.766074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:24.769348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.769348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.769348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] PATH_INFO: `/v3/users/26eb837d21c64b6ea1bf6c886c0376d5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.769836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26eb837d21c64b6ea1bf6c886c0376d5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:24.771773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:24.810958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26b1b9-682d-492a-9050-63ad4f719111 service glance] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:24.824357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:24.825354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:24.825496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:24.827772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:24.830632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:24.838154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:24.960084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1064/2121] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:24 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:24.964451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:24.987154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f05b0-8021-4b4a-a23b-a7287155ef00 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.003149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.004464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.004859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26eb837d21c64b6ea1bf6c886c0376d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:25.004978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.005144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.005869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26eb837d21c64b6ea1bf6c886c0376d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:25.005979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.007750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.025326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26eb837d21c64b6ea1bf6c886c0376d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:25.031331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1065/2122] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:25.035372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:25.054579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b48ecc-3056-4839-85ce-9a2b8566ba75 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.068678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.071797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.072172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.074167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] PATH_INFO: `/v3/projects/dab630f6762f46449c69976ac37d9a56/users/513309ece4a640538904506df6e381fc/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.109892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab630f6762f46449c69976ac37d9a56, user_id=513309ece4a640538904506df6e381fc, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.114861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.129468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26eb837d21c64b6ea1bf6c886c0376d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:25.159111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-25b2ebb4-eaad-4332-9683-e78283b7a57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26eb837d21c64b6ea1bf6c886c0376d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:25.172583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1058/2123] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:24 2022] DELETE /identity/v3/users/26eb837d21c64b6ea1bf6c886c0376d5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:25.174378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.174771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.175057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.195541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:25.197508 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.236337 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1066/2124] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:25 2022] PUT /identity/v3/projects/dab630f6762f46449c69976ac37d9a56/users/513309ece4a640538904506df6e381fc/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:08:25.240785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:25.243110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.298170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1059/2125] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:25.312525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:25.315056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.345215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378c9bb-961d-4d7c-b95e-ad6ca066e705 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.351330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.352296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.352783 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.353549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.354744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.356981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.370719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1067/2126] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:25.375372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:25.413942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04ca1d-a336-4048-b2e7-368027bb8783 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.427285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88d1af-294a-41fd-bf1a-d7825b9fd4d0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.429333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.430792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.431462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.432017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] PATH_INFO: `/v3/projects/dab630f6762f46449c69976ac37d9a56/users/513309ece4a640538904506df6e381fc/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.435234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab630f6762f46449c69976ac37d9a56, user_id=513309ece4a640538904506df6e381fc, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.441082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d961-d083-41d9-959d-0b70da3ff448 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.464877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1068/2127] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:25 2022] PUT /identity/v3/projects/dab630f6762f46449c69976ac37d9a56/users/513309ece4a640538904506df6e381fc/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:25.481803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.482088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.482360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.516946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] MFA Rules not processed for user `513309ece4a640538904506df6e381fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:25.519416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.558171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.559073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.559530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.559965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.575459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.578299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.591592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1060/2128] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:25.644651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1069/2129] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:25 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:25.654894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:25.656070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.730496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efcfaa-c182-4bcd-a923-867a5f7914d5 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:25.808151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:25.814454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:25.814454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:25.814454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:25.814454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:25.943820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:25.946195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bfb73-043c-4879-a0a8-eac6502809e1 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:25.978886 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1061/2130] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:25 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:26.203086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:26.204663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:26.321456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bbfef-0a31-453a-b882-3aad10ed9a7a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:26.326558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:26.328182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.328470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.328791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] PATH_INFO: `/v3/projects/913336e737274ac78c4dea854abb8cf4` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.330409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=913336e737274ac78c4dea854abb8cf4)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:26.332450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:26.520687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913336e737274ac78c4dea854abb8cf4', 'request_id': 'req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:26.540762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913336e737274ac78c4dea854abb8cf4', 'request_id': 'req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:26.604916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.605323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.605702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.635780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] MFA Rules not processed for user `14f6f890deb74eadab6b1ff4b6431036`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:26.637267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:26.642475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913336e737274ac78c4dea854abb8cf4', 'request_id': 'req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:26.653507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] The token cache is being invalidate because project 913336e737274ac78c4dea854abb8cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:26.653801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:26.654489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b57ba9f5-9139-43fa-918e-4fab5d53cb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:26.656957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1070/2131] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:26 2022] DELETE /identity/v3/projects/913336e737274ac78c4dea854abb8cf4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:26.665513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da2c-795d-48f7-a245-c69de05999b8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.665834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da2c-795d-48f7-a245-c69de05999b8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.666452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04da2c-795d-48f7-a245-c69de05999b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.699717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1c04da2c-795d-48f7-a245-c69de05999b8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:26.701195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1c04da2c-795d-48f7-a245-c69de05999b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:26.712511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1062/2132] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:26 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:26.717049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:26.720459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:26.839058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1071/2133] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:26.841521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.841816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.842095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.881447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f62b6-3b91-4eca-8f10-e37fcc38d5d2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:26.885431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:26.888849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:26.892651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:26.893316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.893761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.894301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.895385 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:26.900190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:26.936642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1072/2134] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:26.937681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:26.954883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016906c-3fc6-45b6-bed9-039d4ac55505 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:26.963140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:26.963811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:26.964125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:26.964399 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:26.965162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:26.965470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:26.967077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.003937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1073/2135] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:27.008955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.021458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1063/2136] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:26 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:27.025119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.038049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2430e6-a57c-4241-ad29-ee8fd9d627b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.112156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c1e7-a5bb-4138-96fb-c8155d31d52d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.117891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.118865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.119284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.119663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.120494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.122835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.123945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.125480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.125763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.126328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.126729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.128947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.236417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1064/2137] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:27 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:27.240354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.250950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753b7d-545b-45b0-969a-c49ddcfdaaf8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.256445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.257112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.257394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.257740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.258559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.260560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.268372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1074/2138] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:27 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:27.272025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1065/2139] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:27.273099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.275760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.294884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6570b-3c53-4504-bc39-a23c0da7c58d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.361728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.364159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.364159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.364159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] PATH_INFO: `/v3/projects/7a8a79b146b04d03bc72a00b5d36f046/users/97f15366c3c1404fa4755a3279b73ffd/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.366845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e532-1ba5-4e30-b8b6-91fe52b95019 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.377409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.378445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.379518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.381607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.382655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8a79b146b04d03bc72a00b5d36f046, user_id=97f15366c3c1404fa4755a3279b73ffd, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.383198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.385900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.386883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.486476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1066/2140] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:27 2022] PUT /identity/v3/projects/7a8a79b146b04d03bc72a00b5d36f046/users/97f15366c3c1404fa4755a3279b73ffd/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:27.490548 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.530627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1075/2141] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:27 2022] POST /identity/v3/users => generated 282 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:27.532991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.548728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27079529-a221-4597-ae2c-16e8dbb16c3f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.573981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d1bcc-29ee-4b59-a172-4a1f9bd09ac9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.581082 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.581757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.582040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.582318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.588050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.590730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.631055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1067/2142] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:27.635533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.650389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95ed22-d79b-4c82-8dfd-b7cf75808421 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.656456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.657554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.657948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.658511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] PATH_INFO: `/v3/projects/7a8a79b146b04d03bc72a00b5d36f046/users/97f15366c3c1404fa4755a3279b73ffd/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.660283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.660964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.661130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8a79b146b04d03bc72a00b5d36f046, user_id=97f15366c3c1404fa4755a3279b73ffd, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.661329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.662058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.662382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.664774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.678042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.679020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1068/2143] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:27 2022] PUT /identity/v3/projects/7a8a79b146b04d03bc72a00b5d36f046/users/97f15366c3c1404fa4755a3279b73ffd/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:27.695229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1076/2144] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:27.718025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.806887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba423db-e5fc-4ee5-9dd3-a843d798e3d3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.815424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.817518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.818146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.818797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.820517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.822210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493ef24-4996-4ca2-a4fc-3cc70b36faaf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:27.847583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1069/2145] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:27.853894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:27.874273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda326b0-5fdb-4a68-b2f1-4e531ea0b47a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:27.881603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:27.882665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:27.883207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:27.883549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] PATH_INFO: `/v3/projects/6111f746f2d844dd8b78a5596cc28699/users/11bb82fe6652437fb2177b54f8a1819a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:27.902479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6111f746f2d844dd8b78a5596cc28699, user_id=11bb82fe6652437fb2177b54f8a1819a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:27.905430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f70f-f0cb-49fb-9af3-b6460e84c0bf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:28.046735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1077/2146] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:27 2022] PUT /identity/v3/projects/6111f746f2d844dd8b78a5596cc28699/users/11bb82fe6652437fb2177b54f8a1819a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:28.060702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:28.061860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:28.061860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:28.174448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] MFA Rules not processed for user `11bb82fe6652437fb2177b54f8a1819a`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:28.176630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:28.244673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:28.245252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:28.246253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:28.281484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:28.283721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:28.328835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1070/2147] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:28 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:28.339568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:28.341533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:28.398231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1078/2148] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:08:28 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:28.428843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:28.430512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:28.432234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad9379-ce6d-4e6e-8dab-89a23f3158a8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:28.437792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:28.438976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:28.440696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:28.441076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:28.452836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:28.454704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:28.468138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1071/2149] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:28 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:28.516855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba008-dc5b-4946-8b44-a472ac3f6415 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:28.521836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:28.522697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:28.522823 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:28.523023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:28.532825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:28.534608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa26fb-85d3-4233-9bb0-64b9905a5a04 service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:28.555796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1079/2150] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:29.397474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:29.400088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:29.633003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1338936-b7bc-4c3f-b4a8-687c33f0fba1 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:29.639566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:29.640746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:29.641099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:29.641358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] PATH_INFO: `/v3/users/a1ba4800c9444f80941afddd9082243d` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:29.642612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ba4800c9444f80941afddd9082243d)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:29.646255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:29.903061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ba4800c9444f80941afddd9082243d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:29.903812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ba4800c9444f80941afddd9082243d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:29.952950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ba4800c9444f80941afddd9082243d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:30.125506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ba4800c9444f80941afddd9082243d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:30.159825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ba4800c9444f80941afddd9082243d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:30.173195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1072/2151] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:29 2022] DELETE /identity/v3/users/a1ba4800c9444f80941afddd9082243d => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:30.179938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:30.179938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:30.179938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:30.224140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:30.227340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:30.355128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1080/2152] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:08:30.356969 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:30.361286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:30.546950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6a15b-e02e-4411-bb62-88d7195c7c9e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:30.562241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:30.564105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:30.564396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:30.565316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:30.590453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:30.595370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:30.653876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1073/2153] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:31.813404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:31.816797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:31.858882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f3a1b-c7a9-4d4e-96f3-212264f89126 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:31.879136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:31.882551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:31.883262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:31.883795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] PATH_INFO: `/v3/projects/03cbb76e2f2e4f4db8e0184d378c6311` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:31.900120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cbb76e2f2e4f4db8e0184d378c6311)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:31.902380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:32.128117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cbb76e2f2e4f4db8e0184d378c6311', 'request_id': 'req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.156806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cbb76e2f2e4f4db8e0184d378c6311', 'request_id': 'req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.290601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cbb76e2f2e4f4db8e0184d378c6311', 'request_id': 'req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.338679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] The token cache is being invalidate because project 03cbb76e2f2e4f4db8e0184d378c6311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:32.339365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.341930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.349746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:32.359744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1081/2154] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:31 2022] DELETE /identity/v3/projects/03cbb76e2f2e4f4db8e0184d378c6311 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:32.367209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d8e8-b55e-41c3-864a-b51768a2b9da service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:32.526671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:32.527552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:32.527818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:32.528222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] PATH_INFO: `/v3/users/513309ece4a640538904506df6e381fc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:32.529504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=513309ece4a640538904506df6e381fc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:32.532496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:32.866974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513309ece4a640538904506df6e381fc'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.870289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513309ece4a640538904506df6e381fc'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:32.925458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513309ece4a640538904506df6e381fc'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:33.035063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513309ece4a640538904506df6e381fc'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:33.081557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0a826a59-859f-4071-8e0f-2c9ead13b86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513309ece4a640538904506df6e381fc'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:33.095326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1074/2155] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:08:32 2022] DELETE /identity/v3/users/513309ece4a640538904506df6e381fc => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:34.062465 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:34.069643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:34.134242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24a421-bc4d-4c3b-95b5-a1eaffce2513 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:34.278494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:34.285212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:34.285212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:34.285212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] PATH_INFO: `/v3/projects/dab630f6762f46449c69976ac37d9a56` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:34.285212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab630f6762f46449c69976ac37d9a56)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:34.286508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:34.428788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab630f6762f46449c69976ac37d9a56', 'request_id': 'req-add34c3b-95b2-4521-a3eb-31475f94ee6d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:34.435777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab630f6762f46449c69976ac37d9a56', 'request_id': 'req-add34c3b-95b2-4521-a3eb-31475f94ee6d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:34.552820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab630f6762f46449c69976ac37d9a56', 'request_id': 'req-add34c3b-95b2-4521-a3eb-31475f94ee6d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:34.570807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] The token cache is being invalidate because project dab630f6762f46449c69976ac37d9a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:08:34.571550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:34.573059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-add34c3b-95b2-4521-a3eb-31475f94ee6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:08:34.585050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1082/2156] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:08:34 2022] DELETE /identity/v3/projects/dab630f6762f46449c69976ac37d9a56 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:34.590331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:34.590331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:34.590331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:34.620591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:34.621864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:34.757728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:34.757728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:34.758060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:34.764828 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1075/2157] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:34.808357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:34.809871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:34.822173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1083/2158] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:34.827801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:34.840915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4e44-4743-49aa-ab0a-ded8035f0860 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:34.851811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:34.852759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:34.853786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:34.854239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:34.855138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:08:34.855601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:34.860924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:34.893762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1076/2159] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:08:34.895034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:34.913840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896da0b3-d09e-46c0-bd08-c8fab87cd50f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:34.942321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:34.942321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:34.942321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:34.942321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:34.942643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:34.942643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:35.066402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1084/2160] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:08:34 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:35.070827 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:35.101250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda2c4a-4780-4180-9e63-b02c15665614 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:35.354653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:35.355351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:35.359653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:35.360025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:35.360816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:35.362853 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:35.862744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:35.867442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1077/2161] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:08:35 2022] POST /identity/v3/users => generated 295 bytes in 797 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:08:35.876445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e4f7a-c6de-4d1c-8aa4-3ffeddce7a60 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:35.881101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:35.881756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:35.882032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:35.882301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:35.883022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:35.888586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:35.902739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1085/2162] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:08:35.907741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:35.924147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6793f-3524-426d-8bfb-1453e2d41427 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:35.927282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:35.928045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:35.928320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:35.928646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:35.929608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:35.931505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d096c-bdb3-4289-b1f7-568963e18834 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:35.949800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1078/2163] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:08:35.952574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:35.962889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c53a-55f4-4f13-abb8-bd8cd4e65ab9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:35.986244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:35.986244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:35.986244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:35.986244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] PATH_INFO: `/v3/projects/4aaa564d95c4447abb1e7e01dfd06c19/users/981083ad484845a48a8de536367cd42a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:36.042274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaa564d95c4447abb1e7e01dfd06c19, user_id=981083ad484845a48a8de536367cd42a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:36.045035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:36.199519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f216-dfae-4176-8951-217fae58ab7c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:36.199792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f216-dfae-4176-8951-217fae58ab7c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:36.203256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1f216-dfae-4176-8951-217fae58ab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:36.216126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1086/2164] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:08:35 2022] PUT /identity/v3/projects/4aaa564d95c4447abb1e7e01dfd06c19/users/981083ad484845a48a8de536367cd42a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:08:36.283817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f5c1f216-dfae-4176-8951-217fae58ab7c None None] MFA Rules not processed for user `981083ad484845a48a8de536367cd42a`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:36.285753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f5c1f216-dfae-4176-8951-217fae58ab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:36.445239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1079/2165] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:36 2022] POST /identity/v3/auth/tokens => generated 3409 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:36.457477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:36.460800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:36.676690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba843b0a-bb8d-4043-92e9-7cae2606f188 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:36.690100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:36.691105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:36.691553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:36.694338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:36.714050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:36.715800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fbdff-6c50-487e-b2ad-130ae8f7630f service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:36.729393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1087/2166] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:36 2022] GET /identity/v3/auth/tokens => generated 3409 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:37.617805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:37.619128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:37.620773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:37.677710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] MFA Rules not processed for user `97f15366c3c1404fa4755a3279b73ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:37.681974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:37.884141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1080/2167] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:41.423999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ae4c-fff2-4730-9842-1e1dfb77b70c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:41.424615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ae4c-fff2-4730-9842-1e1dfb77b70c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:41.424615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185ae4c-fff2-4730-9842-1e1dfb77b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:41.444115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7185ae4c-fff2-4730-9842-1e1dfb77b70c None None] MFA Rules not processed for user `b019715a14074e059730965913694e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:41.465991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7185ae4c-fff2-4730-9842-1e1dfb77b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:41.535198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1088/2168] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:41 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:46.230836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:46.232263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:46.312921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbce5-bd0d-4fb2-ab5a-41883d31c5d9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:46.316798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:46.317449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:46.317731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:46.318006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:46.319773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:46.384305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:46.385777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:46.395566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1081/2169] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:46 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:46.675498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:46.676070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:46.676070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:46.694918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:46.696154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:46.752482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1089/2170] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:08:46 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:08:46.765093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:46.766683 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:46.837131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319759-cc7f-4630-9add-630be8f4d191 service glance] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:46.842419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:46.843319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:46.843644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:46.844518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:46.857603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:46.859655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7697e-967a-4863-beee-a6554f6a7d43 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:46.869550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1082/2171] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:08:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:08:54.511610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:08:54.513045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:54.660437 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427431c-cfeb-4319-85ce-b07d4407d24a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:08:54.671113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:08:54.676287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:54.677955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:54.678386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:54.681875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:54.709146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:08:54.713374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396172dc-8100-4b4d-b84f-db820512a172 service placement] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:08:54.729048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1090/2172] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:08:54 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:08:58.952412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811100-4197-436c-a99c-586f0512253d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:08:58.953191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811100-4197-436c-a99c-586f0512253d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:08:58.953191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76811100-4197-436c-a99c-586f0512253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:08:58.973324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-76811100-4197-436c-a99c-586f0512253d None None] MFA Rules not processed for user `14f6f890deb74eadab6b1ff4b6431036`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:08:58.974579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-76811100-4197-436c-a99c-586f0512253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:08:58.982256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1083/2173] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:08:58 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:03.553216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626ad1-0615-497f-b6d9-bb36f3e0fe91 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:03.553999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626ad1-0615-497f-b6d9-bb36f3e0fe91 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:03.553999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626ad1-0615-497f-b6d9-bb36f3e0fe91 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:03.555824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1091/2174] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:09:03.563099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:03.563674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:03.563774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:03.629863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] MFA Rules not processed for user `77dde5aa087649f5873dc17c6fc175c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:03.631199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:03.735591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377df8-831a-46a0-8a82-049f6bba30da None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:03.735881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377df8-831a-46a0-8a82-049f6bba30da None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:03.736215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377df8-831a-46a0-8a82-049f6bba30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:03.739400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1084/2175] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:09:03 2022] POST /identity/v3/auth/tokens => generated 3515 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:03.756241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:03.768811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cdc3e-74e8-4c58-950d-bcf49c86b53d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:03.772951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:03.773688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:03.774974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:03.774974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:03.786761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:03.788752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:03.800890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1c377df8-831a-46a0-8a82-049f6bba30da None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:03.802497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1085/2176] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:03 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:09:03.804022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1c377df8-831a-46a0-8a82-049f6bba30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:03.834888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1092/2177] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:09:03 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:09:03.864004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:03.901185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6dbd8-9dd1-4775-832a-9e8d721b8775 service glance] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:03.910152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:03.910905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:03.911269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:03.911615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:03.923491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:03.925981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb06c9-61ba-4f7e-a48b-20d90ac52be5 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:03.935925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1086/2178] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:09:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:09:04.057709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:04.058033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:04.058941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] PATH_INFO: `/` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:04.060883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1093/2179] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:09:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 02:09:04.067448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:04.068001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:04.068682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:04.092390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:04.094432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:04.158633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1087/2180] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:09:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:04.184714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:04.186467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:04.246940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d4a88-f8e8-42cb-bdf2-abd9bfa01c87 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:04.259898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:04.262135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:04.264293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:04.264973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:04.287318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:04.287318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b0aa3-ba6a-418a-9078-ee4fe809638c service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:04.293779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1094/2181] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:05.769036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:05.858782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5092f-57d0-4a57-8574-567e3b5bff2c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:05.867183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:05.868620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:05.869280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:05.869846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] PATH_INFO: `/v3/users/981083ad484845a48a8de536367cd42a` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:05.871889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981083ad484845a48a8de536367cd42a)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:05.874760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:06.113463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981083ad484845a48a8de536367cd42a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:06.114680 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981083ad484845a48a8de536367cd42a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:06.158915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981083ad484845a48a8de536367cd42a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:06.260863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981083ad484845a48a8de536367cd42a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:06.287189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981083ad484845a48a8de536367cd42a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:06.308451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1088/2182] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:09:05 2022] DELETE /identity/v3/users/981083ad484845a48a8de536367cd42a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:06.316692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:06.316692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:06.316692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:06.341532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:06.345047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:06.445349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1095/2183] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:06 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:06.456265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:06.457761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:06.535199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09a8e-47b6-4600-b78f-dc3a684fd020 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:06.540331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:06.540837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:06.541124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:06.541405 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:06.553610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:06.555514 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:06.574295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1089/2184] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:06 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:07.331965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:07.341221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:07.361604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3992-16fd-4f85-bd70-95e2383863a3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:07.366865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:07.367860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:07.368230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:07.368566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] PATH_INFO: `/v3/projects/4aaa564d95c4447abb1e7e01dfd06c19` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:07.369912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaa564d95c4447abb1e7e01dfd06c19)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:07.371870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:07.951372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaa564d95c4447abb1e7e01dfd06c19', 'request_id': 'req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:07.962921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaa564d95c4447abb1e7e01dfd06c19', 'request_id': 'req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:08.048299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaa564d95c4447abb1e7e01dfd06c19', 'request_id': 'req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:08.088701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] The token cache is being invalidate because project 4aaa564d95c4447abb1e7e01dfd06c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:09:08.089323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:08.090093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d2b32b1b-0e6d-4d33-8aeb-e9877592e940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:08.117136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1096/2185] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:09:07 2022] DELETE /identity/v3/projects/4aaa564d95c4447abb1e7e01dfd06c19 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:14.297596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:14.299010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:14.322453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184b71b-447d-4954-8297-f92c04f65e0a service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:14.388466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:14.389560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:14.390191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:14.390650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] PATH_INFO: `/v3/users/a686a490e3c142bcb8b08cb2ea2c546a` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:14.391934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a686a490e3c142bcb8b08cb2ea2c546a)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:14.395297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:14.596747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a686a490e3c142bcb8b08cb2ea2c546a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:14.597497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a686a490e3c142bcb8b08cb2ea2c546a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:14.614085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a686a490e3c142bcb8b08cb2ea2c546a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:14.690211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a686a490e3c142bcb8b08cb2ea2c546a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:14.705095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a686a490e3c142bcb8b08cb2ea2c546a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:14.712126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1090/2186] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:09:14 2022] DELETE /identity/v3/users/a686a490e3c142bcb8b08cb2ea2c546a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:14.717739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:14.719238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:14.719729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:14.743643 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:14.744895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:14.815471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1097/2187] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:14.826550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:14.827599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:14.901645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49cb9f-bc7b-487e-b0f1-9a03a4ba364c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:14.907628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:14.908329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:14.908615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:14.908895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:14.919115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:14.920739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae309e96-e349-422e-97ab-856cb3d33bfb service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:14.932419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1091/2188] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:15.369579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:15.370009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:15.387699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e8a88-2a63-4f1c-aa68-cae066f457eb None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:15.393055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:15.393814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:15.394084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:15.394430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] PATH_INFO: `/v3/projects/26675948923040c28f4bd83bdc934495` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:15.395664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26675948923040c28f4bd83bdc934495)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:15.397444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:15.537162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26675948923040c28f4bd83bdc934495', 'request_id': 'req-ecc07c6e-8437-42af-bbb0-ecb6d9795511'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:15.547235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26675948923040c28f4bd83bdc934495', 'request_id': 'req-ecc07c6e-8437-42af-bbb0-ecb6d9795511'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:15.628745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26675948923040c28f4bd83bdc934495', 'request_id': 'req-ecc07c6e-8437-42af-bbb0-ecb6d9795511'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:15.640458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] The token cache is being invalidate because project 26675948923040c28f4bd83bdc934495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:09:15.640880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:15.641414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ecc07c6e-8437-42af-bbb0-ecb6d9795511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:15.643161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1098/2189] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:09:15 2022] DELETE /identity/v3/projects/26675948923040c28f4bd83bdc934495 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:15.649274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:15.650522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:15.651167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:15.672153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:15.672294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:15.763694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1092/2190] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:15.775135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:15.775135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:15.775135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:15.799946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:15.804103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:15.810167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1099/2191] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:15.816017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:15.827456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f377c-4464-481e-a182-0643318a5fc1 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:15.832517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:15.833244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:15.833603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:15.833880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:15.834706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:09:15.835030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:15.836726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:15.849217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1093/2192] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:09:15.854383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:15.865284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91f078-9448-4f5d-933e-c8cc40f0cc27 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:15.870686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:15.871394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:15.871602 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:15.871880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:15.872617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:15.886469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.005601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1100/2193] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:09:15 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:09:16.009852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:16.020611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e24a40-0916-41dc-b7fc-2af02e819ae0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:16.085118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:16.085829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.086117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.086395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.087094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:16.089148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.243617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1094/2194] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:09:16 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:09:16.245811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:16.258922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176b6c8-afbc-427b-919f-41853683cccf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:16.263637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:16.264327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.264606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.264878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.265604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:16.267315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.278606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1101/2195] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:09:16.283416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:16.294611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c14700-5067-46ff-b44c-779f91b48de8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:16.303636 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:16.304347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.304627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.304899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.305670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:16.307293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81ab39-f89e-443e-904e-1b9792da1a9e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.318512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1095/2196] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:09:16.322877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:16.333580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb5d8f-271c-457e-b5f4-65a808a418ca admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:16.338474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:16.341625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.341625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.341625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] PATH_INFO: `/v3/projects/a55dde8892fa47bd9941bb1ce9aa3673/users/bb5c39b83f31473696c9b249ab49d780/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.356326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55dde8892fa47bd9941bb1ce9aa3673, user_id=bb5c39b83f31473696c9b249ab49d780, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:16.360198 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.458505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1102/2197] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:09:16 2022] PUT /identity/v3/projects/a55dde8892fa47bd9941bb1ce9aa3673/users/bb5c39b83f31473696c9b249ab49d780/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:16.467529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc64da-eb83-435d-b393-956d02de271c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.469198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc64da-eb83-435d-b393-956d02de271c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.469485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc64da-eb83-435d-b393-956d02de271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.490569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-45bc64da-eb83-435d-b393-956d02de271c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:16.491778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-45bc64da-eb83-435d-b393-956d02de271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:16.555432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1096/2198] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:16.566708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:16.568683 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:16.628687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479588-8216-4781-a82a-38609835dbe7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:16.632507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:16.633156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:16.633448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:16.633708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:16.644556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:16.646041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:16.657164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1103/2199] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:16 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:18.675523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefa5e-e4c9-4c59-9580-effc79bc3265 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:18.676016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefa5e-e4c9-4c59-9580-effc79bc3265 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:18.676115 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbefa5e-e4c9-4c59-9580-effc79bc3265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:18.694209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3cbefa5e-e4c9-4c59-9580-effc79bc3265 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:18.695533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3cbefa5e-e4c9-4c59-9580-effc79bc3265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:18.757843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1097/2200] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:09:18 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:18.783024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:18.786336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:18.875910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68032a89-fdff-4149-ad52-23f70f89f582 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:18.881196 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:18.882000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:18.882473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:18.882680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:18.901565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:18.903929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:18.916561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1104/2201] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:09:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 02:09:24.723607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:24.723607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:24.723607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:24.771613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] MFA Rules not processed for user `bb5c39b83f31473696c9b249ab49d780`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:24.772899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:24.908140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1098/2202] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:24 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:24.912142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:24.924184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a758ed-44de-4124-a28d-5d985265a67d service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:24.928892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:24.929550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:24.929877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:24.930120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:24.930828 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:24.932746 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.049942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1105/2203] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:09:24 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:09:25.054317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:25.078650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8147b-996d-41db-86a6-7fd7306faaf8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:25.196985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:25.198236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:25.198236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:25.198433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:25.199092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:25.201343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.351070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1099/2204] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:09:25 2022] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:09:25.354849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:25.366706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c17941-6806-4cab-8aa2-d25de13afa1f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:25.375016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:25.376239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:25.376756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:25.377493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:25.378433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:25.381435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.397350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1106/2205] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:09:25.403644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:25.420583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b23f9-0538-4e71-85e3-4f894b50e636 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:25.429788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:25.431067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:25.431350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:25.432091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] PATH_INFO: `/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189/users/a58d84f34a0745d7b8229fd9caf5c9d5/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:25.449645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ff1c26e4d4d4b8c8994c34e1f7189, user_id=a58d84f34a0745d7b8229fd9caf5c9d5, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:25.452983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.564702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1100/2206] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:09:25 2022] PUT /identity/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189/users/a58d84f34a0745d7b8229fd9caf5c9d5/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:25.568788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:25.581086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103de6b-9b99-4b32-92e1-bafb1f3e3c10 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:25.706246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:25.708421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:25.708421 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:25.708914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:25.711867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:25.714305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.815402 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1107/2207] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:09:25.816631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:25.816631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2718a-aacf-4df5-a6e2-0edefefc02f4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:25.816631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:25.816631 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:25.817398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:25.817398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] PATH_INFO: `/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189/users/a58d84f34a0745d7b8229fd9caf5c9d5/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:25.817398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463ff1c26e4d4d4b8c8994c34e1f7189, user_id=a58d84f34a0745d7b8229fd9caf5c9d5, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:25.817398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd2bc-3c99-4b71-a522-f3a64233b189 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:25.817398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1101/2208] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:09:25 2022] PUT /identity/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189/users/a58d84f34a0745d7b8229fd9caf5c9d5/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:33.352875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:33.354706 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:33.369056 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5f923-cbd7-40c2-9474-a7a89d146aa3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:33.465226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:33.466099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:33.466385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:33.466658 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] PATH_INFO: `/v3/users/11bb82fe6652437fb2177b54f8a1819a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:33.469529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bb82fe6652437fb2177b54f8a1819a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:33.471601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:33.646064 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:33.646715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:33.646715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:33.668180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bb82fe6652437fb2177b54f8a1819a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:33.676508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bb82fe6652437fb2177b54f8a1819a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:33.683156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] MFA Rules not processed for user `a58d84f34a0745d7b8229fd9caf5c9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:33.685496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:33.692131 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bb82fe6652437fb2177b54f8a1819a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:33.771244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1102/2209] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:33 2022] POST /identity/v3/auth/tokens => generated 3458 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:33.783705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:33.785083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:33.800969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bb82fe6652437fb2177b54f8a1819a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:33.801796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f7043fc0-9e41-4c59-a14f-cc20a58257e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bb82fe6652437fb2177b54f8a1819a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:33.809805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1108/2210] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:09:33 2022] DELETE /identity/v3/users/11bb82fe6652437fb2177b54f8a1819a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:09:33.814908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:33.815485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:33.816077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:33.838274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:33.852150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:33.895448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6c4a2-00fb-4af8-9c82-fc2db8a71ebe None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:33.939412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1109/2211] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:33 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:33.952622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:33.957020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:33.993294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:33.993951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:33.994230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:33.994533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:33.996317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:34.064695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543b31-ac7e-44f9-93fc-e5b32b518a65 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:34.071307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:34.074444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:34.074444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:34.074444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:34.074705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:34.075540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:34.085586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:34.086887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1103/2212] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:34.087383 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c84ee-b3fe-4db6-91e4-64311d4b69ed service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:34.099035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1110/2213] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:33 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:09:34.542311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:34.543731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:34.557476 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8c81b-9d15-4234-9948-596d7fc53e4a service nova] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:34.562183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:34.563081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:34.563301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:34.567531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] PATH_INFO: `/v3/projects/6111f746f2d844dd8b78a5596cc28699` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:34.567531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6111f746f2d844dd8b78a5596cc28699)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:34.567531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:34.697237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6111f746f2d844dd8b78a5596cc28699', 'request_id': 'req-0cb5f16a-cea5-4427-9090-ceb00434500d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:34.703994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6111f746f2d844dd8b78a5596cc28699', 'request_id': 'req-0cb5f16a-cea5-4427-9090-ceb00434500d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:34.800083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6111f746f2d844dd8b78a5596cc28699', 'request_id': 'req-0cb5f16a-cea5-4427-9090-ceb00434500d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:34.811749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] The token cache is being invalidate because project 6111f746f2d844dd8b78a5596cc28699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:09:34.812078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:34.812731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0cb5f16a-cea5-4427-9090-ceb00434500d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:34.814564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1104/2214] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:09:34 2022] DELETE /identity/v3/projects/6111f746f2d844dd8b78a5596cc28699 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:34.820235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:34.820767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:34.820767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:34.848001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:34.849526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:34.922778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1111/2215] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:09:34.931261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:34.931865 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:34.932407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:34.959642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:34.964216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:34.973433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1105/2216] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:09:34.977638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:34.989547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240ffd-52db-42bb-bcba-b33cd441e74a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:34.996076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:34.996856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:34.997207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:34.997546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:34.998353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:09:34.998727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.001064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.013573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1112/2217] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:09:35.019692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.045060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa958-ecb4-4a06-a7a9-d50b70a5de27 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.052191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.052871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.053232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.053419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.054118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.056080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.157563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1106/2218] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:09:35 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:09:35.161563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.174142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915776a-17dc-4cb8-beea-07997c5967b3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.264327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.266382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.267310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.267590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.268330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.270250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.367261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1113/2219] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:09:35 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:09:35.371211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.382281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6325a-0ebd-4f96-827a-f67bb24c0715 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.387223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.388031 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.388418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.388951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.389883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.391859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.404811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1107/2220] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:09:35.409204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.420697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1f47-8b2b-4c01-997c-afd84689b64e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.426010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.426680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.427010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.427292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.428164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.429754 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e969a-4ff4-4106-a54f-1dda2885063f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.446417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1114/2221] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:09:35.450506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.461643 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e50c36-13a8-4ee8-b1f2-71ff3920e21c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.466595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.467573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.467832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.468153 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] PATH_INFO: `/v3/projects/f1594396e15b49dfaf317f0fe0160d9c/users/038fca3c805e4048a524b74bec802988/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.485384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1594396e15b49dfaf317f0fe0160d9c, user_id=038fca3c805e4048a524b74bec802988, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.488145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.552604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1108/2222] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:09:35 2022] PUT /identity/v3/projects/f1594396e15b49dfaf317f0fe0160d9c/users/038fca3c805e4048a524b74bec802988/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:09:35.564070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c8ff-fa1d-4e36-95ab-c7b1cab901dc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.564363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c8ff-fa1d-4e36-95ab-c7b1cab901dc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.564645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57c8ff-fa1d-4e36-95ab-c7b1cab901dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.598593 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fc57c8ff-fa1d-4e36-95ab-c7b1cab901dc None None] MFA Rules not processed for user `038fca3c805e4048a524b74bec802988`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:35.599846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fc57c8ff-fa1d-4e36-95ab-c7b1cab901dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:35.679456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1115/2223] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:35 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:35.686208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:35.689177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:35.757174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ff159-fe72-4cee-8af9-0f6e85bc123e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:35.762073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:35.763059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:35.763350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:35.764140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:35.779732 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:35.781464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4585c0-4b77-4dcb-a292-5b066a100de8 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:35.792303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1109/2224] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:35 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:38.456888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:38.457443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:38.458086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:38.475741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] MFA Rules not processed for user `bb5c39b83f31473696c9b249ab49d780`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:38.477072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:38.544967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1116/2225] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:38 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:45.282860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:45.283359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:45.283452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:45.301637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:45.302846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:45.357590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1110/2226] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:09:45.370372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:45.371804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:45.444670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7686e-da23-4393-8b7b-4a3cdc8eeeb1 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:45.449833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:45.450815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:45.451104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:45.451380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:45.462007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:45.463642 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48c46f-550a-4faf-b766-2fcea4d59929 service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:45.472766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1117/2227] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:09:47.758249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:47.820794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063620bb-6005-48e0-8d91-8a8be2802374 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:47.829189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:47.830079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:47.830361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:47.830633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] PATH_INFO: `/v3/users/038fca3c805e4048a524b74bec802988` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:47.831878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=038fca3c805e4048a524b74bec802988)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:47.833864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:48.060988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038fca3c805e4048a524b74bec802988'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.061917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038fca3c805e4048a524b74bec802988'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.071706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038fca3c805e4048a524b74bec802988'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.143158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038fca3c805e4048a524b74bec802988'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.156250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038fca3c805e4048a524b74bec802988'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.162689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1111/2228] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:09:47 2022] DELETE /identity/v3/users/038fca3c805e4048a524b74bec802988 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:48.167306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:48.168200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:48.168449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:48.187935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:48.189192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:48.261969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1118/2229] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:48.272088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:48.274224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:48.280802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:48.282395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:48.340762 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030fd7-b8f2-4eb6-a941-21a978577adc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:48.345989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:48.346854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:48.347148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:48.347475 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:48.352259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61697f1-53b4-4aa9-8d88-540cd3ecae24 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:48.356227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:48.358901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:48.360237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:48.360560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:48.360665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:48.360844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:48.363102 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:48.370972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1112/2230] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:48.437135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:48.439669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8804-f890-4d7e-b86e-3cfc65ae565c service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:48.452740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1119/2231] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:09:48 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:09:48.838123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:48.839644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:48.856959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8405a-07b2-4a78-850d-50bd6d581e63 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:48.863145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:48.866571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:48.866571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:48.866571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] PATH_INFO: `/v3/projects/f1594396e15b49dfaf317f0fe0160d9c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:48.866571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1594396e15b49dfaf317f0fe0160d9c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:48.868246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:09:48.988357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1594396e15b49dfaf317f0fe0160d9c', 'request_id': 'req-aba159fd-6883-4c0d-b424-c16a94826f89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:48.994467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1594396e15b49dfaf317f0fe0160d9c', 'request_id': 'req-aba159fd-6883-4c0d-b424-c16a94826f89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:49.069379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1594396e15b49dfaf317f0fe0160d9c', 'request_id': 'req-aba159fd-6883-4c0d-b424-c16a94826f89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:49.081025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] The token cache is being invalidate because project f1594396e15b49dfaf317f0fe0160d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:09:49.081237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:49.081975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:09:49.083535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1113/2232] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:09:48 2022] DELETE /identity/v3/projects/f1594396e15b49dfaf317f0fe0160d9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:09:49.344567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:49.345303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:49.345303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:49.361993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] MFA Rules not processed for user `b019715a14074e059730965913694e52`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:09:49.363122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:49.424695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1120/2233] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:09:49 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:09:59.800011 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:09:59.807270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:09:59.868804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba159fd-6883-4c0d-b424-c16a94826f89 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:09:59.873662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:09:59.875056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:09:59.875337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:09:59.875812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] PATH_INFO: `/v3/users/8fd7039b8f074a13b2030a2bb7aaff94` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:09:59.877050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd7039b8f074a13b2030a2bb7aaff94)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:09:59.878959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:00.053568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd7039b8f074a13b2030a2bb7aaff94'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.054217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd7039b8f074a13b2030a2bb7aaff94'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.060890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd7039b8f074a13b2030a2bb7aaff94'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.119559 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd7039b8f074a13b2030a2bb7aaff94'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.133141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-716d1122-c842-495e-b335-62fd1c46c2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd7039b8f074a13b2030a2bb7aaff94'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.140940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1114/2234] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:09:59 2022] DELETE /identity/v3/users/8fd7039b8f074a13b2030a2bb7aaff94 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:00.393988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:00.407230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f03d9-412b-4754-b7c5-811764eeb171 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:00.482069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:00.482986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:00.483275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:00.483545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] PATH_INFO: `/v3/projects/cc19a0f9c33f47f1b504bebbb0b2c931` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:00.485926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc19a0f9c33f47f1b504bebbb0b2c931)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:00.487833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:00.593000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'request_id': 'req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.598659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'request_id': 'req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.677702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'request_id': 'req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.689819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] The token cache is being invalidate because project cc19a0f9c33f47f1b504bebbb0b2c931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:00.690106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.690743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e940fbaa-b6ed-466b-8a3d-15f00e271fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:00.692391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1121/2235] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:00 2022] DELETE /identity/v3/projects/cc19a0f9c33f47f1b504bebbb0b2c931 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:00.698162 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:00.701878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:00.701878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:00.716708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:00.717935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:00.785841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1115/2236] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:00.793762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:00.794046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:00.794317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:00.814891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:00.816117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:00.824462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1122/2237] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:00 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:00.828826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:00.839613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3302-0c56-4d93-9ae1-e3c08dd71cc9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:00.845151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:00.845815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:00.846100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:00.846388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:00.847110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:00.847418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:00.849135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:00.863107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1116/2238] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:10:00.867550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:00.877926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c30b4-0b88-4261-b55a-33aa2710f36b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:00.883368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:00.884892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:00.884892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:00.884892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:00.885559 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:00.888008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:00.998906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1123/2239] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:00 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:01.003795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.014109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89590989-74b0-4cdc-94fc-6aa4c41f4812 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.069757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.070421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.070701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.070984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.071660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.073584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.182665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1117/2240] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:01 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:01.187048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.197969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb99241-ecb1-4799-b83a-20804fde9d80 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.203013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.209574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.209574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.209574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.209574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.209574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.217577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1124/2241] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:01.223218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.240536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e715-7ac9-4fed-ba2c-cf2bfea5ac40 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.246127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.246842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.247168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.247486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.248371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.250247 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4fec8-e9bb-4ecc-9c34-d8e196c38583 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.260479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1118/2242] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:01.264842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.275042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65aa5-7aa3-4164-a8a5-7d6967b5c12b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.279958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.281546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.281832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.282109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] PATH_INFO: `/v3/projects/94135c1a5b72481a9e8d914838bbc011/users/8658b6bb86ee4737bda8540e7be48c6a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.297394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94135c1a5b72481a9e8d914838bbc011, user_id=8658b6bb86ee4737bda8540e7be48c6a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.300221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.380651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1125/2243] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:01 2022] PUT /identity/v3/projects/94135c1a5b72481a9e8d914838bbc011/users/8658b6bb86ee4737bda8540e7be48c6a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:01.396391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.396698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.396976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.426942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] MFA Rules not processed for user `8658b6bb86ee4737bda8540e7be48c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:01.428201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:01.491357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1119/2244] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:01 2022] POST /identity/v3/auth/tokens => generated 3425 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:01.496032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.558922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063d751-de29-4c4d-88d8-cf2b3399052c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.565910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.565910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.565910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.566305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.566818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.568741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.684378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1126/2245] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:01 2022] POST /identity/v3/projects => generated 403 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:01.702017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.713696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392b913-bef2-4488-badb-c2e2631600a0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.777673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.778342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.778764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.778880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.779553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.782152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.896581 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1120/2246] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:01 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:01.900666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.910562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192122-68b3-43f5-9fff-3de0b175ed80 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.915155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.915834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.916149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.916424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.917687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.918769 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:01.932212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1127/2247] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:01.933451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:01.944447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e109ac-3b5f-440a-91d4-e75b646a1468 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:01.949343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:01.950232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:01.950502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:01.950777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] PATH_INFO: `/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b/users/49154d8166614055bd2f354f2b901986/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:01.967204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe55a1ede9b241e19cc091ac69e70f9b, user_id=49154d8166614055bd2f354f2b901986, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:01.970602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:02.072342 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1121/2248] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:01 2022] PUT /identity/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b/users/49154d8166614055bd2f354f2b901986/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:02.076373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:02.087057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2e7f5-5c1a-48ce-8688-5525e104dbd6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:02.148797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:02.149748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.150038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.150315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:02.151046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:02.152761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6fef6-478e-4b9b-b459-c795879b03d4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:02.164738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1128/2249] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:02.170746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:02.181556 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e5fd-cb35-4f06-9ffd-63b5efd6c8b0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:02.186243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:02.187621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.188159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.188291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] PATH_INFO: `/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b/users/49154d8166614055bd2f354f2b901986/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:02.190264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe55a1ede9b241e19cc091ac69e70f9b, user_id=49154d8166614055bd2f354f2b901986, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:02.193173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:02.204138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1122/2250] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:02 2022] PUT /identity/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b/users/49154d8166614055bd2f354f2b901986/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:02.214170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.214503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.214777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:02.245064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] MFA Rules not processed for user `49154d8166614055bd2f354f2b901986`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:02.246189 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:02.315080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1129/2251] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:02 2022] POST /identity/v3/auth/tokens => generated 3490 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:02.334000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:02.335836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:02.400073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387052-be7f-4967-a16c-fd4288677983 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:02.403734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:02.404406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.404691 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.404970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:02.415615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:02.417961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe987ae7-5cfd-42c6-ba79-e96af9e7b8a1 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:02.426467 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1123/2252] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:02 2022] GET /identity/v3/auth/tokens => generated 3490 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:02.582181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:02.649915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93db33a-af7f-49ce-89b7-8abfa9567cfd None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:02.654704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:02.655594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.655957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.656269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] PATH_INFO: `/v3/users/8658b6bb86ee4737bda8540e7be48c6a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:02.657515 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8658b6bb86ee4737bda8540e7be48c6a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:02.659469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:02.870860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8658b6bb86ee4737bda8540e7be48c6a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:02.873051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8658b6bb86ee4737bda8540e7be48c6a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:02.885782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8658b6bb86ee4737bda8540e7be48c6a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:02.972124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8658b6bb86ee4737bda8540e7be48c6a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:02.972744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8658b6bb86ee4737bda8540e7be48c6a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:02.979019 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1130/2253] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:02 2022] DELETE /identity/v3/users/8658b6bb86ee4737bda8540e7be48c6a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:02.983520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:02.984054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:02.984151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:03.003071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:03.004325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:03.061357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1124/2254] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:02 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:03.071492 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:03.073209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:03.130233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f5228-8ef0-4d04-8e44-cb007c1500a6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:03.133855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:03.134494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:03.134777 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:03.135052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:03.146093 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:03.147623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:03.162363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1131/2255] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:03 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:03.613081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:03.614509 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:03.627725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb4a69-b048-4a37-865f-0091c1503a5a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:03.632454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:03.633307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:03.633593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:03.633914 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] PATH_INFO: `/v3/projects/94135c1a5b72481a9e8d914838bbc011` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:03.635040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94135c1a5b72481a9e8d914838bbc011)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:03.637061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:03.732053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94135c1a5b72481a9e8d914838bbc011', 'request_id': 'req-1fdfa1ee-9bc9-4113-a574-126acaa14699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:03.738809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94135c1a5b72481a9e8d914838bbc011', 'request_id': 'req-1fdfa1ee-9bc9-4113-a574-126acaa14699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:03.832045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94135c1a5b72481a9e8d914838bbc011', 'request_id': 'req-1fdfa1ee-9bc9-4113-a574-126acaa14699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:03.842797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] The token cache is being invalidate because project 94135c1a5b72481a9e8d914838bbc011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:03.843314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:03.844416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:03.845948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1125/2256] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:03 2022] DELETE /identity/v3/projects/94135c1a5b72481a9e8d914838bbc011 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:03.850175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:03.860188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60078b6-65dd-43e3-9afb-4e740234f90c service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:03.923844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:03.923844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:03.924179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:03.924551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] PATH_INFO: `/v3/users/49154d8166614055bd2f354f2b901986` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:03.926280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49154d8166614055bd2f354f2b901986)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:03.928302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:04.130304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49154d8166614055bd2f354f2b901986'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:04.138825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49154d8166614055bd2f354f2b901986'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:04.151257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49154d8166614055bd2f354f2b901986'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:04.274289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49154d8166614055bd2f354f2b901986'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:04.274969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cd5650d9-e086-438f-9876-4403eab23ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49154d8166614055bd2f354f2b901986'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:04.281697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1132/2257] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:03 2022] DELETE /identity/v3/users/49154d8166614055bd2f354f2b901986 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:04.730408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:04.732767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:04.758158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfa1ee-9bc9-4113-a574-126acaa14699 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:04.841004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:04.842139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:04.842426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:04.842782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] PATH_INFO: `/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:04.846160 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe55a1ede9b241e19cc091ac69e70f9b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:04.848255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.036579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe55a1ede9b241e19cc091ac69e70f9b', 'request_id': 'req-62d81ee6-7e98-4c9a-abca-622b1708f9a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:05.045893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe55a1ede9b241e19cc091ac69e70f9b', 'request_id': 'req-62d81ee6-7e98-4c9a-abca-622b1708f9a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:05.143753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe55a1ede9b241e19cc091ac69e70f9b', 'request_id': 'req-62d81ee6-7e98-4c9a-abca-622b1708f9a1'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:05.158036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] The token cache is being invalidate because project fe55a1ede9b241e19cc091ac69e70f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:05.158629 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:05.159654 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62d81ee6-7e98-4c9a-abca-622b1708f9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:05.162163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1126/2258] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:04 2022] DELETE /identity/v3/projects/fe55a1ede9b241e19cc091ac69e70f9b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:05.168558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.170066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.176901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.194872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:05.196474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:05.293201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1133/2259] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:05.301715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.302007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.302267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.323942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:05.330136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:05.335785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1127/2260] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:05 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:05.340241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.352007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571ea72-d2cc-458b-bc8c-3692928bae86 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.357077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.359698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.359698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.359698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.359698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:05.360308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.361638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.373351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1134/2261] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:10:05.378795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.387959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47509c-64c4-40f7-b99d-898f1fcd8857 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.393255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.393891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.394099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.394368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.395063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.396997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.513304 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1128/2262] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:05 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:05.514478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.525104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a103-5d4f-4334-8019-ab64f31093e6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.583695 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.585235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.585235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.585235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.585929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.587533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.686005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1135/2263] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:05 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:05.697218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.707583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9595-4ea0-4e37-b252-ce72e6253d4f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.712278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.712931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.713211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.713483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.714197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.715809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.727197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1129/2264] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:05.731171 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.741826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db456f2a-7d08-4986-b659-3683325be7f3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.746600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.747230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.747514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.747791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.748574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.750209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bce1a-18ad-440d-aa9e-c7e08266209b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.760985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1136/2265] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:05.765847 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:05.775549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d3e51-fa9b-4f61-a6c7-c7110d19cc1b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:05.780242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:05.781773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.782835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.782835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] PATH_INFO: `/v3/projects/1cd6ddb70b8d476ca85edf6fe0ead9d5/users/58f340afcbe74ef0afcebfe8ff7f8a89/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.797909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd6ddb70b8d476ca85edf6fe0ead9d5, user_id=58f340afcbe74ef0afcebfe8ff7f8a89, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:05.800608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:05.911044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1130/2266] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:05 2022] PUT /identity/v3/projects/1cd6ddb70b8d476ca85edf6fe0ead9d5/users/58f340afcbe74ef0afcebfe8ff7f8a89/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:05.922491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:05.923324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:05.926955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:05.954518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] MFA Rules not processed for user `58f340afcbe74ef0afcebfe8ff7f8a89`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:05.955763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:06.035359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1137/2267] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:05 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:06.040240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.111513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5678-87c9-4140-9ecd-7a346f3e2b8c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.116546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.117205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.117487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.117761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.118463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.120392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.235701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1131/2268] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:06 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:06.238698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.252616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d3b3-4061-4d6f-b635-0cb88c292137 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.325132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.326273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.326700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.326981 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.327809 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.329771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.440478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1138/2269] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:06 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:06.444606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.456765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d312-1bd4-4d6b-bf21-c6bda449cb47 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.461919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.462594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.462879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.463407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.464269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.465917 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.481540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1132/2270] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:06.482768 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.505119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4b79-8860-49ef-bff5-db9ccfc96df2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.509888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.510772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.511055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.511359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] PATH_INFO: `/v3/projects/7ce9eddd83714d459e0eda28cfff87e6/users/fde656aa74eb44a8961a2679e03f8ff7/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.527867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce9eddd83714d459e0eda28cfff87e6, user_id=fde656aa74eb44a8961a2679e03f8ff7, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.530626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.600740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1139/2271] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:06 2022] PUT /identity/v3/projects/7ce9eddd83714d459e0eda28cfff87e6/users/fde656aa74eb44a8961a2679e03f8ff7/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:06.606661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.615092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e44107-2d41-4abe-9b28-3a1c9392b645 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.671485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.672335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.672685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.673028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.673825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.675497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c885a-53fb-4bcb-b430-3a8da40ddd45 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.689107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1133/2272] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:06.692115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.708149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03ad7-76ec-48ac-ad43-c63e7bd75aaf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.718810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.720381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.720671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.721020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] PATH_INFO: `/v3/projects/7ce9eddd83714d459e0eda28cfff87e6/users/fde656aa74eb44a8961a2679e03f8ff7/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.723312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce9eddd83714d459e0eda28cfff87e6, user_id=fde656aa74eb44a8961a2679e03f8ff7, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.726008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.737612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1140/2273] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:06 2022] PUT /identity/v3/projects/7ce9eddd83714d459e0eda28cfff87e6/users/fde656aa74eb44a8961a2679e03f8ff7/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:06.748408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.748701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.748984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.777182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] MFA Rules not processed for user `fde656aa74eb44a8961a2679e03f8ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:06.778389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:06.850155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1134/2274] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:06 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:06.861484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:06.863214 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:06.922630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390b18c-ddd0-477a-ac62-964009b8a93b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:06.926332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:06.926976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:06.927254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:06.927532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:06.938028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:06.939455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bef0-a009-4924-beea-419f8553952e service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:06.949036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1141/2275] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:06 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:07.345841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:07.410875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9b4d5-8adc-441a-b6c4-02a00cd5dea0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:07.415506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:07.416389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:07.416674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:07.416948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] PATH_INFO: `/v3/users/58f340afcbe74ef0afcebfe8ff7f8a89` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:07.418124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f340afcbe74ef0afcebfe8ff7f8a89)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:07.420053 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:07.620197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f340afcbe74ef0afcebfe8ff7f8a89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:07.620851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f340afcbe74ef0afcebfe8ff7f8a89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:07.627647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f340afcbe74ef0afcebfe8ff7f8a89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:07.690842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f340afcbe74ef0afcebfe8ff7f8a89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:07.704646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f340afcbe74ef0afcebfe8ff7f8a89'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:07.710921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1135/2276] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:07 2022] DELETE /identity/v3/users/58f340afcbe74ef0afcebfe8ff7f8a89 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:07.715662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:07.716159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:07.716270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:07.736422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:07.737858 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:07.798382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1142/2277] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:07 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:07.811128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:07.812807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:07.874104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2772e-b4b6-48cb-b6f7-acb6b5bf66c6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:07.878663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:07.879303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:07.879585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:07.879857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:07.888866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:07.891290 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:07.900879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1136/2278] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:07 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:08.338697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:08.340292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:08.352940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d7000-bb46-452c-aebd-0423f00c0b4c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:08.357967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:08.361606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:08.361606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:08.361606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] PATH_INFO: `/v3/projects/1cd6ddb70b8d476ca85edf6fe0ead9d5` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:08.362187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd6ddb70b8d476ca85edf6fe0ead9d5)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:08.364071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:08.511755 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd6ddb70b8d476ca85edf6fe0ead9d5', 'request_id': 'req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.516934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd6ddb70b8d476ca85edf6fe0ead9d5', 'request_id': 'req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.591589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd6ddb70b8d476ca85edf6fe0ead9d5', 'request_id': 'req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.604059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] The token cache is being invalidate because project 1cd6ddb70b8d476ca85edf6fe0ead9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:08.604348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.604980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.606500 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1143/2279] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:08 2022] DELETE /identity/v3/projects/1cd6ddb70b8d476ca85edf6fe0ead9d5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:08.611347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:08.620997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea541-4de0-43dc-ab4d-b694cfed1c1f service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:08.678222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:08.679154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:08.679400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:08.679767 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] PATH_INFO: `/v3/users/fde656aa74eb44a8961a2679e03f8ff7` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:08.681176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde656aa74eb44a8961a2679e03f8ff7)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:08.683090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:08.868294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde656aa74eb44a8961a2679e03f8ff7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.868950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde656aa74eb44a8961a2679e03f8ff7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.875610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde656aa74eb44a8961a2679e03f8ff7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.936579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde656aa74eb44a8961a2679e03f8ff7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.948873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a0256768-c128-4319-9b4f-99b6834e29b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde656aa74eb44a8961a2679e03f8ff7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:08.955528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1137/2280] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:08 2022] DELETE /identity/v3/users/fde656aa74eb44a8961a2679e03f8ff7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:09.418220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:09.419668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:09.440994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2346a0b-65d1-4e4b-8c79-c05b7f467f82 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:09.500487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:09.501405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:09.501670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:09.501948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] PATH_INFO: `/v3/projects/7ce9eddd83714d459e0eda28cfff87e6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:09.503439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce9eddd83714d459e0eda28cfff87e6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:09.505103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:09.643948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce9eddd83714d459e0eda28cfff87e6', 'request_id': 'req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:09.650797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce9eddd83714d459e0eda28cfff87e6', 'request_id': 'req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:09.730889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce9eddd83714d459e0eda28cfff87e6', 'request_id': 'req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:09.742494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] The token cache is being invalidate because project 7ce9eddd83714d459e0eda28cfff87e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:09.742785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:09.743429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b64f8f9b-5a1b-4104-b1d4-d7c016856be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:09.744990 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1144/2281] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:09 2022] DELETE /identity/v3/projects/7ce9eddd83714d459e0eda28cfff87e6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:09.751061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:09.751282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:09.751555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:09.770714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:09.771825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:09.832594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1138/2282] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:09.840988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:09.841371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:09.841759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:09.863126 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:09.864627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:09.873362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1145/2283] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:09.877812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:09.888042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdc715-b0b7-458c-a033-4eb9c2f6bb77 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:09.893317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:09.893971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:09.894248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:09.894518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:09.895314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:09.895624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:09.897250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:09.910108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1139/2284] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:10:09.914488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:09.929710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8462a-14a5-4f64-9daf-6816857b1a32 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:09.934376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:09.935023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:09.935331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:09.935578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:09.936302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:09.938316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.041165 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1146/2285] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:09 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:10.046584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.056708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc75c33-0509-41bf-a980-2e927b1d2bf2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.112995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.113655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.113938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.114213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.114885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.116927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.232665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1140/2286] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:10 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:10.237558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.248127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0758b-7d10-4fbc-80dc-6c38058b255d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.252882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.253525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.253803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.254077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.254789 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.256410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.267157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1147/2287] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:10.271096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.282527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ed99-aad7-4a69-b61e-1021ca67ef4a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.288433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.289013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.289189 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.289462 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.290195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.291852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1fe8f-e601-4d02-be63-bab8c8380d22 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.303496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1141/2288] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:10.307886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.318032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811343f9-4c12-4df8-a58b-771ef5d43c5d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.325023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.326015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.326298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.326575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] PATH_INFO: `/v3/projects/9f872eb2dca54a97a771e884c3710a8c/users/c4a86bbbbda8447fbb071c137106eb09/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.341597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f872eb2dca54a97a771e884c3710a8c, user_id=c4a86bbbbda8447fbb071c137106eb09, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.345458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.412188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1148/2289] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:10 2022] PUT /identity/v3/projects/9f872eb2dca54a97a771e884c3710a8c/users/c4a86bbbbda8447fbb071c137106eb09/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:10.423383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.423673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.425440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.451366 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] MFA Rules not processed for user `c4a86bbbbda8447fbb071c137106eb09`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:10.453149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:10.518638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1142/2290] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:10 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:10.523139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.585973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8977b2-bdbd-4f53-985f-9c07e2118042 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.590592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.591210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.597381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.597381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.597381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.597381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.684210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1149/2291] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:10 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:10.685411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.696540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6d17-7802-41a0-ac6d-fc2990c18034 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.761102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.761772 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.762050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.762325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.763030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.765603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.844630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1143/2292] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:10 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:10.848613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.860181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872a04-32f7-442a-b911-fb5acb04b4bc admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.865032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.865681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.865965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.866241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.866962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.868691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.879613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1150/2293] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:10.883702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.896029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8bfc1-8ed3-47a2-b208-9de980e68f25 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.900851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.901669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.901951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.902226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.902940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.904641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15f9c7-bfb3-44cc-9543-76badade41ae admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:10.914985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1144/2294] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:10.919200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:10.929483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c81c5-695d-4663-8ea3-a46274d0554a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:10.934194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:10.937303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:10.937303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:10.937303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] PATH_INFO: `/v3/projects/6427cef81f2743a7a62ebd85c4451c9d/users/a4e4701579154d6f8d5c3c6098c85077/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:10.951058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6427cef81f2743a7a62ebd85c4451c9d, user_id=a4e4701579154d6f8d5c3c6098c85077, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:10.954684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.010957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1151/2295] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:10 2022] PUT /identity/v3/projects/6427cef81f2743a7a62ebd85c4451c9d/users/a4e4701579154d6f8d5c3c6098c85077/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:11.026757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.027052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.027348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.055801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] MFA Rules not processed for user `a4e4701579154d6f8d5c3c6098c85077`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:11.057054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:11.125989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1145/2296] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:11 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:11.131203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.205068 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f799dee-fe7d-4e0a-bde7-35014f926c34 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.214248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.216812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.217407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.217407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.218170 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.220667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.314480 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1152/2297] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:11 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:11.319042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.331675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33270d7a-48ff-4527-a12b-185233f6cbb5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.402252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.402912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.403196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.403471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.407832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.407832 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.508756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1146/2298] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:11 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:11.512787 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.523686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50441f88-1f42-48cd-8122-2d5c2bacfee5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.528668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.529359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.529647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.529925 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.530709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.532531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.543086 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1153/2299] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:11.550280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.560129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f2cb7-7a79-45cc-90c5-9e1f10213a80 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.565645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.566513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.566790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.567063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] PATH_INFO: `/v3/projects/5d31d8d305be49a9b277d702503128c3/users/c66a3bff64694a469ebb0bb3b032e247/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.581521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d31d8d305be49a9b277d702503128c3, user_id=c66a3bff64694a469ebb0bb3b032e247, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.584330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.665928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1147/2300] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:11 2022] PUT /identity/v3/projects/5d31d8d305be49a9b277d702503128c3/users/c66a3bff64694a469ebb0bb3b032e247/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:11.669957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.680553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70fc0-5d61-43ca-9418-f5d8e38c8cb9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.734557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.735160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.735445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.735726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.736488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.738138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff37c6-ac5d-4062-b583-68f34385ec0c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.747833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1154/2301] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:11.752191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.762301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebf2e8-2c5b-4809-875e-76876220f424 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.767051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.767942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.768261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.768517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] PATH_INFO: `/v3/projects/5d31d8d305be49a9b277d702503128c3/users/c66a3bff64694a469ebb0bb3b032e247/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.770438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d31d8d305be49a9b277d702503128c3, user_id=c66a3bff64694a469ebb0bb3b032e247, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.773080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.783542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1148/2302] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:11 2022] PUT /identity/v3/projects/5d31d8d305be49a9b277d702503128c3/users/c66a3bff64694a469ebb0bb3b032e247/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:11.793576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.793864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.794139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.820949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] MFA Rules not processed for user `c66a3bff64694a469ebb0bb3b032e247`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:11.822139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:11.890757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1155/2303] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:11 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:11.900939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:11.902689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:11.961230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b535d44-8751-464d-bf25-ee7e4fdd2ad5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:11.964957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:11.965639 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:11.965924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:11.966201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:11.976661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:11.978086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:11.989957 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1149/2304] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:11 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:13.147174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:13.147174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:13.158780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a13f-6fd0-4e9c-9391-d09e46a59e2b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:13.162339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:13.162968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:13.163247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:13.163517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:13.218289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:13.220940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:13.230592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1156/2305] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:13 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:18.154241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:18.162981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b0fb8-cb30-4cc4-b016-7428efcc4f51 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:18.166700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:18.167339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:18.167673 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:18.167889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:18.228417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:18.229862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac771a73-5871-4008-884a-2be177df1ed2 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:18.240302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1150/2306] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:18 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:22.657506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:22.719187 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee4c95-2037-4e56-b179-b1d3eb8e1bca service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:22.724552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:22.725420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:22.725703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:22.725976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] PATH_INFO: `/v3/users/c4a86bbbbda8447fbb071c137106eb09` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:22.727174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a86bbbbda8447fbb071c137106eb09)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:22.729120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:23.039040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a86bbbbda8447fbb071c137106eb09'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:23.046186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a86bbbbda8447fbb071c137106eb09'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:23.060624 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a86bbbbda8447fbb071c137106eb09'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:23.143494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a86bbbbda8447fbb071c137106eb09'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:23.144517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a86bbbbda8447fbb071c137106eb09'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:23.155714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1157/2307] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:22 2022] DELETE /identity/v3/users/c4a86bbbbda8447fbb071c137106eb09 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:23.156701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:23.157260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:23.157260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:23.176995 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:23.178350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:23.242492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1151/2308] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:23.252967 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:23.255172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:23.319322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bfc71-2de0-4211-a216-87a00326d4e2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:23.322987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:23.323631 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:23.323917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:23.324227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:23.334036 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:23.336180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:23.345862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1158/2309] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:23.886105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:23.887655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:23.902036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a4f3-8d17-4844-ad5a-fc8302a8886e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:23.907086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:23.908994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:23.909360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:23.909703 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] PATH_INFO: `/v3/projects/9f872eb2dca54a97a771e884c3710a8c` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:23.910902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f872eb2dca54a97a771e884c3710a8c)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:23.913139 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:24.062801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f872eb2dca54a97a771e884c3710a8c', 'request_id': 'req-3da3acfa-b008-4efb-bad4-9182be22b332'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.069172 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f872eb2dca54a97a771e884c3710a8c', 'request_id': 'req-3da3acfa-b008-4efb-bad4-9182be22b332'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.205938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f872eb2dca54a97a771e884c3710a8c', 'request_id': 'req-3da3acfa-b008-4efb-bad4-9182be22b332'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.217528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] The token cache is being invalidate because project 9f872eb2dca54a97a771e884c3710a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:24.217819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.218534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.221002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1152/2310] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:23 2022] DELETE /identity/v3/projects/9f872eb2dca54a97a771e884c3710a8c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:24.225182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:24.235902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbef0b-c941-447c-adbc-af814c08d046 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:24.300346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:24.301322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:24.301601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:24.301874 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] PATH_INFO: `/v3/users/a4e4701579154d6f8d5c3c6098c85077` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:24.303094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e4701579154d6f8d5c3c6098c85077)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:24.305101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:24.524044 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:24.525482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:24.558493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e4701579154d6f8d5c3c6098c85077'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.567320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e4701579154d6f8d5c3c6098c85077'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.582394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e4701579154d6f8d5c3c6098c85077'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.587095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3acfa-b008-4efb-bad4-9182be22b332 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:24.590862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:24.591507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:24.591791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:24.592108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:24.594147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:24.681868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:24.683323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:24.694426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1153/2311] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:24 2022] GET /identity/v3/auth/tokens => generated 3458 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:10:24.696501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e4701579154d6f8d5c3c6098c85077'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.697115 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e4701579154d6f8d5c3c6098c85077'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:24.707887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1159/2312] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:24 2022] DELETE /identity/v3/users/a4e4701579154d6f8d5c3c6098c85077 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:25.270130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:25.271632 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:25.288306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8993e1d-1e21-407c-8a22-eb9d5ee0ff78 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:25.349220 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:25.350013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:25.350302 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:25.350575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] PATH_INFO: `/v3/projects/6427cef81f2743a7a62ebd85c4451c9d` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:25.351802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6427cef81f2743a7a62ebd85c4451c9d)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:25.353773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:25.497279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6427cef81f2743a7a62ebd85c4451c9d', 'request_id': 'req-4f670536-0794-4690-a59e-d21cc68ac82c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.503414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6427cef81f2743a7a62ebd85c4451c9d', 'request_id': 'req-4f670536-0794-4690-a59e-d21cc68ac82c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.627797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6427cef81f2743a7a62ebd85c4451c9d', 'request_id': 'req-4f670536-0794-4690-a59e-d21cc68ac82c'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.639020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] The token cache is being invalidate because project 6427cef81f2743a7a62ebd85c4451c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:25.648322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.648322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.648322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1154/2313] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:25 2022] DELETE /identity/v3/projects/6427cef81f2743a7a62ebd85c4451c9d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:25.648596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:25.648596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:25.661376 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bca1-2227-4887-ae01-64aa9ab40f7b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:25.716813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:25.717674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:25.717951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:25.718224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] PATH_INFO: `/v3/users/c66a3bff64694a469ebb0bb3b032e247` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:25.719405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66a3bff64694a469ebb0bb3b032e247)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:25.722229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:25.930820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66a3bff64694a469ebb0bb3b032e247'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.937870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66a3bff64694a469ebb0bb3b032e247'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:25.949837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66a3bff64694a469ebb0bb3b032e247'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.020613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66a3bff64694a469ebb0bb3b032e247'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.021173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-28d236a6-d3b9-434f-9529-7d8664509e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66a3bff64694a469ebb0bb3b032e247'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.028217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1160/2314] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:25 2022] DELETE /identity/v3/users/c66a3bff64694a469ebb0bb3b032e247 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:26.467602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:26.470494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:26.494552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f670536-0794-4690-a59e-d21cc68ac82c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:26.567730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:26.567730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:26.567730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:26.567730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] PATH_INFO: `/v3/projects/5d31d8d305be49a9b277d702503128c3` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:26.568255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d31d8d305be49a9b277d702503128c3)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:26.569161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:26.677114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d31d8d305be49a9b277d702503128c3', 'request_id': 'req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.683439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d31d8d305be49a9b277d702503128c3', 'request_id': 'req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.792014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d31d8d305be49a9b277d702503128c3', 'request_id': 'req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.804285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] The token cache is being invalidate because project 5d31d8d305be49a9b277d702503128c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:26.804603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.805474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d85e1db9-c26c-42b1-ad37-5a7cfaccf18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:26.807652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1155/2315] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:26 2022] DELETE /identity/v3/projects/5d31d8d305be49a9b277d702503128c3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:26.815558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:26.816116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:26.816225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:26.839538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:26.841111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:26.936954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1161/2316] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:26.946617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:26.946909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:26.947192 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:26.967739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:26.969028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:26.977962 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1156/2317] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:26.988841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:26.998955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aec2f5-a4ee-49ec-a67d-b45b2fb75020 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.010108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.010806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.011227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.011371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.012173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:27.012488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.014152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.030298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1162/2318] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:10:27.034971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.044378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a25a3-53d7-4400-86ce-ee8589e8fa54 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.050034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.050759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.051155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.051689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.052400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.054380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.164889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1157/2319] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:27 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:27.166104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.179824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd443c-d1fc-49ef-8085-9dc65fd95e6d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.244655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.245600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.245883 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.246161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.246859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.248786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.364579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1163/2320] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:27 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:27.369124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.379833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4030-9c3a-4d15-addf-3a3e363f4def admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.384447 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.385105 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.385389 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.385663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.386384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.389974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.406815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.408007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1158/2321] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:27.418061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459f7ba-9744-4f2f-8caa-73bb3f96ea62 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.430392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.431069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.431356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.431635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.432400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.434186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c517c-a21d-4225-998e-414b97e87e45 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.446346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1164/2322] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:27.450661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.462801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71264-f461-49ba-a204-11b2fa674476 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.467952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.469042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.469346 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.469992 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] PATH_INFO: `/v3/projects/938cccf2187b4571b21ff0340a256f9b/users/2588c4b912004b1787c88dede27af2b9/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.487670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938cccf2187b4571b21ff0340a256f9b, user_id=2588c4b912004b1787c88dede27af2b9, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.490356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.580754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1159/2323] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:27 2022] PUT /identity/v3/projects/938cccf2187b4571b21ff0340a256f9b/users/2588c4b912004b1787c88dede27af2b9/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:27.586020 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.586221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.586491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.618512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] MFA Rules not processed for user `2588c4b912004b1787c88dede27af2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:27.620011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:27.703199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1165/2324] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:27 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:27.707397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.784335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0161b-9894-4d1f-b443-79d8fc71e284 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:27.794918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:27.795810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:27.796218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:27.796612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:27.797414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:27.801199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:27.946333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1160/2325] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:27 2022] POST /identity/v3/projects => generated 379 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:27.950290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:27.965978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cae40-c6d8-4d47-8293-4a6d5c5e95dc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.039523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.041032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.041032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.041032 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.041523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.043449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.131237 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1166/2326] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:27 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:28.132836 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:28.154074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18617a9-6400-4a30-aec6-82ae5cb1fcd4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.162921 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.164134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.164588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.165045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.166286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.169268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.184393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1161/2327] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:28.188648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:28.202442 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135424-4d73-48f8-8df5-b6559c684cd8 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.234017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.234017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.234017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.234017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] PATH_INFO: `/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6/users/2a711f94316e414696be430dbdd81354/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.234576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a5539a5b9145548df4fc8ed3b349c6, user_id=2a711f94316e414696be430dbdd81354, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.238370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.453085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1167/2328] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:28 2022] PUT /identity/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6/users/2a711f94316e414696be430dbdd81354/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:28.461493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:28.473634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d99e1-a608-4f0a-9167-652a9c71aeb5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.567578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.568451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.568735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.569052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.569813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.571474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71706e64-c8fe-44f3-a18a-4f9be3a7a680 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.584533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1162/2329] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:28.590262 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:28.606362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fdd5-0381-4ebe-89cc-a1bffab14e09 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.617811 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.618875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.619238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.619433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] PATH_INFO: `/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6/users/2a711f94316e414696be430dbdd81354/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.621758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a5539a5b9145548df4fc8ed3b349c6, user_id=2a711f94316e414696be430dbdd81354, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.624553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.646076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1168/2330] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:28 2022] PUT /identity/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6/users/2a711f94316e414696be430dbdd81354/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:28.656356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.656667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.656950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.704019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] MFA Rules not processed for user `2a711f94316e414696be430dbdd81354`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:28.707171 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:28.826823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1163/2331] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:28 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:28.839281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:28.841153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:28.908910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbe142-9c22-4c11-9062-8b91c3a377af admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:28.913319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:28.913898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:28.914224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:28.914508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:28.924580 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:28.926947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:28.937568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1169/2332] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:28 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:10:29.107224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:29.118473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2987b63-313b-4656-b9b6-ab665798fa82 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:29.122261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:29.122922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:29.123209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:29.123489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:29.200701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:29.202372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951fb1d-1374-4caf-b447-c1dc27d921c7 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:29.213094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1164/2333] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:29 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:29.883112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:29.944487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8989f-e458-454f-beb3-576c8171a7f3 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:29.949405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:29.950281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:29.950567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:29.950845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] PATH_INFO: `/v3/users/2588c4b912004b1787c88dede27af2b9` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:29.952089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2588c4b912004b1787c88dede27af2b9)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:29.954732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:30.173662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2588c4b912004b1787c88dede27af2b9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:30.180461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2588c4b912004b1787c88dede27af2b9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:30.192167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2588c4b912004b1787c88dede27af2b9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:30.331345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2588c4b912004b1787c88dede27af2b9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:30.334470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2588c4b912004b1787c88dede27af2b9'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:30.338441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1170/2334] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:29 2022] DELETE /identity/v3/users/2588c4b912004b1787c88dede27af2b9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:30.343003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:30.343487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:30.343675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:30.361628 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:30.362968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:30.426919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1165/2335] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:30.437084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:30.438979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:30.496003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02556541-2f91-4c1b-8754-131f2f61fa12 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:30.499568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:30.500228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:30.500506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:30.500776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:30.510472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:30.511896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:30.530568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1171/2336] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:30 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:31.006981 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:31.008415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:31.020538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef69fe-6698-4c3b-a4c8-b63cead28ee8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:31.025488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:31.026329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:31.026609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:31.026883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] PATH_INFO: `/v3/projects/938cccf2187b4571b21ff0340a256f9b` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:31.028187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=938cccf2187b4571b21ff0340a256f9b)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:31.030074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:31.159927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938cccf2187b4571b21ff0340a256f9b', 'request_id': 'req-5a712588-dbe2-45ba-bc89-893dd4fded9f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.166456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938cccf2187b4571b21ff0340a256f9b', 'request_id': 'req-5a712588-dbe2-45ba-bc89-893dd4fded9f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.306265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938cccf2187b4571b21ff0340a256f9b', 'request_id': 'req-5a712588-dbe2-45ba-bc89-893dd4fded9f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.317039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] The token cache is being invalidate because project 938cccf2187b4571b21ff0340a256f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:31.317324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.318487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.320038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1166/2337] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:31 2022] DELETE /identity/v3/projects/938cccf2187b4571b21ff0340a256f9b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:31.323919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:31.333630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30090a16-2e92-47ca-928d-c041a9ead3f1 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:31.388446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:31.389411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:31.389693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:31.389964 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] PATH_INFO: `/v3/users/2a711f94316e414696be430dbdd81354` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:31.391249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a711f94316e414696be430dbdd81354)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:31.394066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:31.607790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a711f94316e414696be430dbdd81354'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.614325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a711f94316e414696be430dbdd81354'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.625440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a711f94316e414696be430dbdd81354'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.711533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a711f94316e414696be430dbdd81354'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.712213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e8259e14-222b-4a15-b5e6-66aab871344c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a711f94316e414696be430dbdd81354'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:31.718499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1172/2338] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:31 2022] DELETE /identity/v3/users/2a711f94316e414696be430dbdd81354 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:32.138905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:32.141194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:32.168801 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a712588-dbe2-45ba-bc89-893dd4fded9f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:32.229460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:32.230501 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.230779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.231049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] PATH_INFO: `/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.232264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a5539a5b9145548df4fc8ed3b349c6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:32.234168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:32.439241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a5539a5b9145548df4fc8ed3b349c6', 'request_id': 'req-a55e040b-de65-4cb2-b4b4-7dad8c42b642'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:32.445719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a5539a5b9145548df4fc8ed3b349c6', 'request_id': 'req-a55e040b-de65-4cb2-b4b4-7dad8c42b642'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:32.530719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a5539a5b9145548df4fc8ed3b349c6', 'request_id': 'req-a55e040b-de65-4cb2-b4b4-7dad8c42b642'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:32.554306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] The token cache is being invalidate because project c1a5539a5b9145548df4fc8ed3b349c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:32.554730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:32.555443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a55e040b-de65-4cb2-b4b4-7dad8c42b642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:32.557301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1167/2339] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:32 2022] DELETE /identity/v3/projects/c1a5539a5b9145548df4fc8ed3b349c6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:32.562886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.564541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.564541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.585545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:32.586888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:32.650613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1173/2340] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:32.660127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.660402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.660674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.681594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:32.682819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:32.698571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1168/2341] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:32.702253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:32.714267 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc88ebf-1f2e-4336-99ff-a6b003c9e59b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:32.721039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:32.721707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.721994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.722265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.723347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:32.723347 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:32.725143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:32.737504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1174/2342] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:10:32.741912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:32.752253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78585bf5-9cc9-413d-8fb6-c19cdc4c79e2 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:32.759363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:32.759625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.759998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.760369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.761209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:32.763191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:32.899057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1169/2343] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:32 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:32.903294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:32.913709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ef57-fc37-4534-88ea-1d83fa1fa910 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:32.974280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:32.974956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:32.975239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:32.975512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:32.976306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:32.978217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:33.085688 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1175/2344] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:32 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:33.089802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:33.100489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a68ea-b575-4d40-8db8-2e51528a6cc4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:33.105307 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:33.116149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:33.116149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:33.116149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:33.116149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:33.116149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:33.124474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1170/2345] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:33.125622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:33.137471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aaf0d-bcd2-4558-b61a-ea50c1776c25 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:33.143495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:33.148717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:33.148717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:33.148717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:33.148717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:33.148717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57f8ae-6585-4aba-a220-1f16634a3515 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:33.161537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1176/2346] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:33.162717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:33.175584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafd4b6-721b-45c2-bc90-fe85f4cb62b5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:33.182017 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:33.182965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:33.183400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:33.183714 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] PATH_INFO: `/v3/projects/1a8dab7e762c40d0a4278c1ac84b8c13/users/db3d808e4a3a4059895a795c6d3bea5a/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:33.201821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8dab7e762c40d0a4278c1ac84b8c13, user_id=db3d808e4a3a4059895a795c6d3bea5a, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:33.219266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:33.301939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1171/2347] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:33 2022] PUT /identity/v3/projects/1a8dab7e762c40d0a4278c1ac84b8c13/users/db3d808e4a3a4059895a795c6d3bea5a/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:33.312127 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:33.312530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:33.312914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:33.340645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] MFA Rules not processed for user `db3d808e4a3a4059895a795c6d3bea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:33.341840 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:33.405254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1177/2348] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:33 2022] POST /identity/v3/auth/tokens => generated 3389 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:33.418272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:33.425303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:33.477790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9013bb0-4c29-443a-808b-d60ee52fc87e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:33.481406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a1d87117d143488e1701ac0407ff28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:33.482038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:33.482318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:33.482590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:33.491359 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:33.492817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:33.501561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1172/2349] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:33 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:10:47.547374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:47.549943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:47.619948 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46ce18-4241-4742-8284-545b4b387687 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:47.625096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:47.626792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:47.626792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:47.626792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] PATH_INFO: `/v3/users/b019715a14074e059730965913694e52` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:47.627805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b019715a14074e059730965913694e52)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:47.630299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:47.869483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b019715a14074e059730965913694e52'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:47.876132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b019715a14074e059730965913694e52'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:47.888782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b019715a14074e059730965913694e52'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:47.962606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b019715a14074e059730965913694e52'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:47.963221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a4a26612-3ba8-4e52-9a3c-04cb8cdac923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b019715a14074e059730965913694e52'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:47.969298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1178/2350] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:47 2022] DELETE /identity/v3/users/b019715a14074e059730965913694e52 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:48.221937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:48.236025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deefd3-dbf7-4963-87e7-fefe803c4ac7 service glance] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:48.299600 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:48.304609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.304609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.304609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] PATH_INFO: `/v3/projects/2b66ddee4c864aae90b738695dffbeb9` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.304609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b66ddee4c864aae90b738695dffbeb9)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:48.305340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:48.401876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b66ddee4c864aae90b738695dffbeb9', 'request_id': 'req-9050ce8f-f3bc-4044-9744-f1a249edde06'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:48.408329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b66ddee4c864aae90b738695dffbeb9', 'request_id': 'req-9050ce8f-f3bc-4044-9744-f1a249edde06'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:48.508657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b66ddee4c864aae90b738695dffbeb9', 'request_id': 'req-9050ce8f-f3bc-4044-9744-f1a249edde06'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:48.520818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] The token cache is being invalidate because project 2b66ddee4c864aae90b738695dffbeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:48.521141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:48.522100 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-9050ce8f-f3bc-4044-9744-f1a249edde06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:48.523910 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1173/2351] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:48 2022] DELETE /identity/v3/projects/2b66ddee4c864aae90b738695dffbeb9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:48.529892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.530180 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.530452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.548879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:48.550080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:48.612931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1179/2352] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:48.620543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.620826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.621103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.639392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:48.640612 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:48.649411 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1174/2353] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:48.653588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:48.664590 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355cd2d-4420-4992-ba7f-c9f8e6d7b184 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:48.669696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:48.670390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.670684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.670980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.671748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:48.672116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:48.673717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:48.685917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1180/2354] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:10:48.690682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:48.700622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b994498-983d-4fa9-b03c-dd58e46f4376 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:48.705558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:48.706195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.706477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.706756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.707452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:48.710198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:48.856008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1175/2355] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:48 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:10:48.857674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:48.880893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8863e67-d9c1-448c-90be-5815a72a6536 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:48.940591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:48.941329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:48.943798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:48.943798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:48.943798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:48.945293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.028930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1181/2356] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:48 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:49.033236 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:49.045001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37740-73f4-449e-a4c3-2d3d73486133 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:49.049800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:49.050588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.050885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.051167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.052107 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:49.053744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.064555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1176/2357] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:49.069860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:49.081136 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096dc87-17d9-45cf-a5a7-dffacd9f0adb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:49.087105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:49.087904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.088261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.088583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.089361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:49.091195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b5cb9-a3c7-4524-bc5d-75ff19b42328 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.103186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1182/2358] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:49.107546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:49.119523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f6d6-1495-45fe-9329-d870e0a80278 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:49.124777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:49.125642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.125984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.126244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] PATH_INFO: `/v3/projects/ac06b449fcbd4bfa964c5048cff0964a/users/a3947bd7568847e8bfa82f9380a99699/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.146103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac06b449fcbd4bfa964c5048cff0964a, user_id=a3947bd7568847e8bfa82f9380a99699, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:49.149450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.263455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1177/2359] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:49 2022] PUT /identity/v3/projects/ac06b449fcbd4bfa964c5048cff0964a/users/a3947bd7568847e8bfa82f9380a99699/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:49.276046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adba8a-3c3b-4acc-ab4a-5e2c5734f55d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.276487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adba8a-3c3b-4acc-ab4a-5e2c5734f55d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.277043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adba8a-3c3b-4acc-ab4a-5e2c5734f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.308003 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-d4adba8a-3c3b-4acc-ab4a-5e2c5734f55d None None] MFA Rules not processed for user `a3947bd7568847e8bfa82f9380a99699`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:49.309451 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d4adba8a-3c3b-4acc-ab4a-5e2c5734f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:49.379529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1183/2360] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:49 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:49.391477 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:49.393263 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:49.472833 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557962d1-40b5-460b-93f3-95fad1deeb98 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:49.478735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:49.479378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:49.479665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:49.479945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:49.487620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:49.489814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:49.498562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1178/2361] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:49 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:10:52.350257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a7d-6055-454e-9b76-4bfe952ec62d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:52.350766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a7d-6055-454e-9b76-4bfe952ec62d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:52.350881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8a7d-6055-454e-9b76-4bfe952ec62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:52.370332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9c0f8a7d-6055-454e-9b76-4bfe952ec62d None None] MFA Rules not processed for user `a6e7ef3a7fd145e5ab8726786ba318bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:52.372090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9c0f8a7d-6055-454e-9b76-4bfe952ec62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:52.430364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1184/2362] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:52 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:52.931217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:53.001155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03071d-509d-4c28-bbcf-d196389c1d1e service nova] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:53.006843 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:53.009248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:53.009248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:53.009248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] PATH_INFO: `/v3/users/a3947bd7568847e8bfa82f9380a99699` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:53.011390 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3947bd7568847e8bfa82f9380a99699)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:53.011705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:53.195909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3947bd7568847e8bfa82f9380a99699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:53.201547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3947bd7568847e8bfa82f9380a99699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:53.206497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3947bd7568847e8bfa82f9380a99699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:53.335275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3947bd7568847e8bfa82f9380a99699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:53.347928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3947bd7568847e8bfa82f9380a99699'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:53.354983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1179/2363] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:10:52 2022] DELETE /identity/v3/users/a3947bd7568847e8bfa82f9380a99699 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:53.359464 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:53.360038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:53.360153 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:53.377611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:53.378819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:53.436851 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1185/2364] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:53 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:53.448005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:53.449700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:53.511792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0718f6-2fdb-454b-a56d-4ce93762bdbc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:53.515442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:53.516113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:53.516395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:53.516728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:53.527540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:53.529083 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb172e-a5ab-442d-9698-43f77c9449e3 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:53.539705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1180/2365] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:53 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:10:54.045027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.045027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:54.045225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac79a7-4981-42aa-b897-f50c97183c52 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.050208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.051089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.051374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.052280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] PATH_INFO: `/v3/projects/ac06b449fcbd4bfa964c5048cff0964a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.053944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac06b449fcbd4bfa964c5048cff0964a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.055849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.216461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac06b449fcbd4bfa964c5048cff0964a', 'request_id': 'req-cb44224d-13a8-478f-a139-6fe79109d6f3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:54.222855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac06b449fcbd4bfa964c5048cff0964a', 'request_id': 'req-cb44224d-13a8-478f-a139-6fe79109d6f3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:54.325076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac06b449fcbd4bfa964c5048cff0964a', 'request_id': 'req-cb44224d-13a8-478f-a139-6fe79109d6f3'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:54.336884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] The token cache is being invalidate because project ac06b449fcbd4bfa964c5048cff0964a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:10:54.337318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:54.338034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-cb44224d-13a8-478f-a139-6fe79109d6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:10:54.339629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1186/2366] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:10:54 2022] DELETE /identity/v3/projects/ac06b449fcbd4bfa964c5048cff0964a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:54.354054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.354608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.354608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.372710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:54.373974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:54.432842 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1181/2367] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:54.441004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.441493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.441636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.459770 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:54.461142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:54.469244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1187/2368] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:54.474239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.484753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef856a39-56c8-4ec4-b33d-4a5787c9949b None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.490647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.491288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.491568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.491841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.492708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:10:54.493018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.494687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.506681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1182/2369] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:10:54.511351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.521164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e24e-66f7-49fe-82c2-46f8aed3bc57 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.526118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.526774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.527067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.527345 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.528095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.530767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.618661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1188/2370] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:54 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:54.622932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.634245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bd313-04fa-42c7-a541-fef24d8b486d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.689805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.690880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.691174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.691459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.692190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.694156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.811454 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1183/2371] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:54 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:54.815561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.826009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee6282-1315-4123-baa5-9f125f659b2d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.830636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.831282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.831572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.831846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.832606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.834712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.845563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1189/2372] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:54.850862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.860769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c828b-39f9-46b6-aebb-acab81935adc admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.865867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.866523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.866809 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.867087 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.867812 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.869439 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fbf4e-f1e4-47e9-91b8-6f01906fac4b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:54.879523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1184/2373] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:54.884023 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:54.894193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47830ce7-f28a-46e6-b762-9b56e1702a54 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:54.899623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:54.900523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:54.900799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:54.901071 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] PATH_INFO: `/v3/projects/dd04b3c686b6485dbabc94f888272d12/users/70f231455c3845609c5825abfbb937ef/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:54.915953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd04b3c686b6485dbabc94f888272d12, user_id=70f231455c3845609c5825abfbb937ef, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:54.918710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.000996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1190/2374] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:54 2022] PUT /identity/v3/projects/dd04b3c686b6485dbabc94f888272d12/users/70f231455c3845609c5825abfbb937ef/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:55.014652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.014958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.015250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.043320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] MFA Rules not processed for user `70f231455c3845609c5825abfbb937ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:55.044735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:55.115733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1185/2375] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:10:55.120501 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.183167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fa88f-2ee9-4c0d-bb7e-f60f80c8f1a3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.188491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.189212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.189534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.189850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.190612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.193455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.282035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1191/2376] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:10:55 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:55.286510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.298747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c2ef5-0b27-4ab8-8f82-7aa064fb7704 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.356790 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.357516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.357807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.358052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.358735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.360676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.467713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1186/2377] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:10:55 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:10:55.471915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.482875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3433d-e3bb-4387-acc0-c236a7d41793 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.487388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.488069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.488353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.488628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.489408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.491254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.502722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1192/2378] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:10:55.507483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.517525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea5a00-592a-418a-a3d7-f64b9c3174f3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.522834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.523702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.524016 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.524292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] PATH_INFO: `/v3/projects/ff8228da1bce46cfa79985742c230867/users/3810cce0e1ed4ea1a7c848129ab4cd84/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.539881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8228da1bce46cfa79985742c230867, user_id=3810cce0e1ed4ea1a7c848129ab4cd84, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.542546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.668711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1187/2379] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:55 2022] PUT /identity/v3/projects/ff8228da1bce46cfa79985742c230867/users/3810cce0e1ed4ea1a7c848129ab4cd84/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:10:55.679847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.689713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218ad6d-a839-4207-bb9a-a3f1e4fce733 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.744863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.745517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.745798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.746067 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.746804 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.748450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490bc60-a183-496a-94da-64a77faaf58d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.758535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1193/2380] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:10:55.762669 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.773633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02618093-27cd-4740-87c5-aa40252b6440 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.778322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.779187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.779469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.779741 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] PATH_INFO: `/v3/projects/ff8228da1bce46cfa79985742c230867/users/3810cce0e1ed4ea1a7c848129ab4cd84/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.781755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8228da1bce46cfa79985742c230867, user_id=3810cce0e1ed4ea1a7c848129ab4cd84, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.784410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.794823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1188/2381] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:10:55 2022] PUT /identity/v3/projects/ff8228da1bce46cfa79985742c230867/users/3810cce0e1ed4ea1a7c848129ab4cd84/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:10:55.805024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.805312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.808782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.834810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] MFA Rules not processed for user `3810cce0e1ed4ea1a7c848129ab4cd84`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:10:55.836052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:55.901998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1194/2382] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:10:55 2022] POST /identity/v3/auth/tokens => generated 3448 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:10:55.912626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:55.914420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:10:55.969371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bae4-a559-427c-8c1c-8d7c80578f0f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:55.973215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:55.973862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:55.974144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:55.974416 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:55.983173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:55.984615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:55.994138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1189/2383] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:55 2022] GET /identity/v3/auth/tokens => generated 3448 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:10:56.200567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:10:56.210370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb58f7-da8f-49df-9470-2ac669489619 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:10:56.215217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:10:56.215217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:10:56.215217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:10:56.215217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:10:56.271813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:10:56.273281 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:10:56.282233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1195/2384] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:01.201259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:01.202705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:01.262402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfc62-9d77-43ff-8a2e-8dfd97721e0a service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:01.266368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:01.267014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:01.267293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:01.267615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:01.269630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:01.342795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:01.344320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:01.356803 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1190/2385] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:01 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:02.524897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:02.534055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2128a-961d-4625-a9d4-cb900fc18b28 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:02.537737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:02.538435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:02.539536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:02.539536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:02.541028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:02.555419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:02.556930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec4720-ef9b-43bc-90a9-c560f677001d service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:02.568954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1196/2386] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:02 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:12.104057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:12.168110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b8c2e-21da-484b-b2e1-c50996f55688 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:12.173969 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:12.177060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:12.177060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:12.177060 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] PATH_INFO: `/v3/users/70f231455c3845609c5825abfbb937ef` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:12.177351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f231455c3845609c5825abfbb937ef)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:12.179432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:12.392233 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f231455c3845609c5825abfbb937ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:12.392835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f231455c3845609c5825abfbb937ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:12.399839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f231455c3845609c5825abfbb937ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:12.465996 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f231455c3845609c5825abfbb937ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:12.480881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f231455c3845609c5825abfbb937ef'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:12.493360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1191/2387] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:12 2022] DELETE /identity/v3/users/70f231455c3845609c5825abfbb937ef => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:12.498556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:12.499203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:12.499203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:12.517183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:12.518664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:12.584709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1197/2388] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:12.598413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:12.599943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:12.662510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a524d-367f-4abc-b019-89a8151a76ba admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:12.667191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:12.667839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:12.668158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:12.668435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:12.678241 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:12.680188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:12.690264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1192/2389] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:12 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:13.207354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:13.208929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:13.221764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769ea90-2fe3-427c-8884-f097bd026dbe None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:13.228332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:13.229193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:13.229472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:13.229844 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] PATH_INFO: `/v3/projects/dd04b3c686b6485dbabc94f888272d12` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:13.230991 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd04b3c686b6485dbabc94f888272d12)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:13.234287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:13.346253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd04b3c686b6485dbabc94f888272d12', 'request_id': 'req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.351719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd04b3c686b6485dbabc94f888272d12', 'request_id': 'req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.462137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd04b3c686b6485dbabc94f888272d12', 'request_id': 'req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.474297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] The token cache is being invalidate because project dd04b3c686b6485dbabc94f888272d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:13.474647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.475386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.477179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1198/2390] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:13 2022] DELETE /identity/v3/projects/dd04b3c686b6485dbabc94f888272d12 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:13.481616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:13.491550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf132ea-b970-491c-813f-11e808d85e6d service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:13.554387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:13.555367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:13.556388 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:13.556734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] PATH_INFO: `/v3/users/3810cce0e1ed4ea1a7c848129ab4cd84` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:13.558270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3810cce0e1ed4ea1a7c848129ab4cd84)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:13.560547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:13.780006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3810cce0e1ed4ea1a7c848129ab4cd84'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.780687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3810cce0e1ed4ea1a7c848129ab4cd84'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.788430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3810cce0e1ed4ea1a7c848129ab4cd84'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.888717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3810cce0e1ed4ea1a7c848129ab4cd84'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.901825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3810cce0e1ed4ea1a7c848129ab4cd84'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:13.907864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1193/2391] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:13 2022] DELETE /identity/v3/users/3810cce0e1ed4ea1a7c848129ab4cd84 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:14.216210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.217757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.292070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29ff2-d601-41a5-8243-ef40c2a33a1f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.314589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.314589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.361634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:14.362333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.362621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.362904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.364728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.386305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0e23c-66c0-45e6-b5a7-2a303b6f8952 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.390887 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:14.391756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.392051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.392330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] PATH_INFO: `/v3/projects/ff8228da1bce46cfa79985742c230867` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.393515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8228da1bce46cfa79985742c230867)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:14.395473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:14.424423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:14.426010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:14.435458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1199/2392] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3407 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:14.466698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.472779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.482156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb47e-3736-4574-8f66-4076da080372 service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.487614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:14.488517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.488802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.489079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] PATH_INFO: `/v3/users/db3d808e4a3a4059895a795c6d3bea5a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.490320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3d808e4a3a4059895a795c6d3bea5a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:14.492393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:14.519090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8228da1bce46cfa79985742c230867', 'request_id': 'req-6b608334-83d5-4824-8990-349454f856fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.526468 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8228da1bce46cfa79985742c230867', 'request_id': 'req-6b608334-83d5-4824-8990-349454f856fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.616671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8228da1bce46cfa79985742c230867', 'request_id': 'req-6b608334-83d5-4824-8990-349454f856fd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.628194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] The token cache is being invalidate because project ff8228da1bce46cfa79985742c230867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:14.629837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.631330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-6b608334-83d5-4824-8990-349454f856fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.633351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1194/2393] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:14 2022] DELETE /identity/v3/projects/ff8228da1bce46cfa79985742c230867 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:14.639455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83c86-b688-41ca-afcf-ebe0b90267a3 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.639754 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83c86-b688-41ca-afcf-ebe0b90267a3 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.640062 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83c86-b688-41ca-afcf-ebe0b90267a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.659469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-8bb83c86-b688-41ca-afcf-ebe0b90267a3 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:14.660728 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8bb83c86-b688-41ca-afcf-ebe0b90267a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.693414 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3d808e4a3a4059895a795c6d3bea5a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.701637 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3d808e4a3a4059895a795c6d3bea5a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.715764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3d808e4a3a4059895a795c6d3bea5a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.729515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1195/2394] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:14.737635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.737964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.738246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.761538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:14.762753 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.770937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1196/2395] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:14.776111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.788181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f991e4-2be9-4e96-a4c5-5a7b5a4b5b52 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.794491 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:14.798681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:14.811852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1197/2396] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:11:14.814029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3d808e4a3a4059895a795c6d3bea5a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.814850 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2c803b44-177f-4da2-b94a-41192eff794a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3d808e4a3a4059895a795c6d3bea5a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:14.816656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.818490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.822613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1200/2397] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:14 2022] DELETE /identity/v3/users/db3d808e4a3a4059895a795c6d3bea5a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:14.827384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.827855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.828865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.832676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf0a2-b641-4d49-9e2d-d9343f54260b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.849888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:14.851449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.897025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:14.897724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:14.898010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:14.898288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:14.898989 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:14.901871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:14.917980 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1201/2398] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:14 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:14.928684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:14.932508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:14.992358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1198/2399] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:14 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:14.993327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1532986-0bb0-4a34-bde1-2c96cd77c746 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:14.994133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.046928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.047669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.047965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.048303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.059525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e43421-9e30-4c1d-9ce8-d484677f5242 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.064747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.065518 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.065823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.067541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.067541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.069277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.113802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.115119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.126024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1202/2400] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:14 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:15.166090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1199/2401] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:14 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:15.170038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.180289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f699-29a5-4915-94f0-9f649a24b22f service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.187929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.187929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.187929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.187929 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.188475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.190066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.204938 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1203/2402] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:15.208855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.224086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca565-e7a7-4ff1-841f-219344f61c0e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.230648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.231357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.231637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.231911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.232742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.234421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f56fc-19f1-4b00-97b4-4ac02aece7cb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.246027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1200/2403] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:15.250385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.262301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66d8b-30be-4ba9-9e16-7b9bd350ba25 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.267380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.268330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.268614 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.268891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] PATH_INFO: `/v3/projects/e70486dd15f44d1da4eb6f992dc1fb3b/users/2682a1a6286143b9a3e6dda49fd2ac15/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.286303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70486dd15f44d1da4eb6f992dc1fb3b, user_id=2682a1a6286143b9a3e6dda49fd2ac15, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.289018 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.415191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1204/2404] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:15 2022] PUT /identity/v3/projects/e70486dd15f44d1da4eb6f992dc1fb3b/users/2682a1a6286143b9a3e6dda49fd2ac15/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:15.428287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.428756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.429163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.461459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] MFA Rules not processed for user `2682a1a6286143b9a3e6dda49fd2ac15`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:15.463279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:15.531756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1201/2405] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:15 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:15.536369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.581396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.582829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:15.603737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a04cf-d807-400f-b4af-647946a09cb5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.609570 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.611439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.611439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.615355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.615355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.615355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.665445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7b6b-576b-4078-8bc8-be210ed50bce None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.671174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.672133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.672443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.672761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] PATH_INFO: `/v3/projects/1a8dab7e762c40d0a4278c1ac84b8c13` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.674181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8dab7e762c40d0a4278c1ac84b8c13)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.676562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.746551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1205/2406] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:15.747889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.810890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17821d-bec7-4d58-8636-2d586c384c4b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.815893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:15.816578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.816899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.817143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:15.817857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:15.819752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:15.851367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8dab7e762c40d0a4278c1ac84b8c13', 'request_id': 'req-a6466236-9059-4bb8-b691-7fe8eaf3ea76'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:15.857900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8dab7e762c40d0a4278c1ac84b8c13', 'request_id': 'req-a6466236-9059-4bb8-b691-7fe8eaf3ea76'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:15.935243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1206/2407] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:15 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:15.936420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:15.947156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcd0e9-cebe-4f3e-af21-9f679b3b8c47 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:15.959168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8dab7e762c40d0a4278c1ac84b8c13', 'request_id': 'req-a6466236-9059-4bb8-b691-7fe8eaf3ea76'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:15.972283 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] The token cache is being invalidate because project 1a8dab7e762c40d0a4278c1ac84b8c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:15.972584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:15.974849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a6466236-9059-4bb8-b691-7fe8eaf3ea76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:15.982183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1202/2408] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:15 2022] DELETE /identity/v3/projects/1a8dab7e762c40d0a4278c1ac84b8c13 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:15.983285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7d02-8e4e-4c22-a565-444ab3129945 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:15.983573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7d02-8e4e-4c22-a565-444ab3129945 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:15.983903 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d7d02-8e4e-4c22-a565-444ab3129945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.014550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bd5d7d02-8e4e-4c22-a565-444ab3129945 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:16.016036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bd5d7d02-8e4e-4c22-a565-444ab3129945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.020944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.021633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.021933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.022314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.023159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.026320 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.027184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1203/2409] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:15 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:16.038333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1207/2410] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:16.046098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.046524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.046943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.047431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.051341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.072027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef672cb-1e96-4054-852a-842abb44ff54 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.072916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:16.075039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.077380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.079135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.079135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.079135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] PATH_INFO: `/v3/projects/591a621d5cc74617992848c69862abbb/users/11aab6c2055f4f5fb3a12ef4990d5b08/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.088993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1204/2411] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:16.093497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.097608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=591a621d5cc74617992848c69862abbb, user_id=11aab6c2055f4f5fb3a12ef4990d5b08, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.100647 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.103615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffca537-a577-4cc9-a1b0-4073924c753a None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.108719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.109372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.109663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.110020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.110952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:16.111315 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.114466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.127451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1205/2412] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:11:16.131794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.145730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc17b1-985b-4343-a8f8-3951474dd3e1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.153334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.154025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.154312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.154590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.155281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.157391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.181772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1208/2413] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:16 2022] PUT /identity/v3/projects/591a621d5cc74617992848c69862abbb/users/11aab6c2055f4f5fb3a12ef4990d5b08/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:16.183230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.185040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.245565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d791a4b-46c0-4b95-a6fe-90a15347b61f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.249627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.250323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.250625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.253434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.253434 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.264357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.264602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1206/2414] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:16 2022] POST /identity/v3/projects => generated 399 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:16.265996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.266197 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.275344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1209/2415] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:16.276359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.360820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834c14c-4cb9-4777-b95f-598a9f8342d1 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.418130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de076c-baed-4dde-8789-0b2da7b266ef admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.431081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.431741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.432668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.432999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.433321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.434240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.435298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.436303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.436537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.437128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.438984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.447952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.472786 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1207/2416] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:16.476975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.488634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5d9d-5b9a-4510-ba25-ccf326a95950 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.499536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.499536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.499536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.499536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] PATH_INFO: `/v3/projects/591a621d5cc74617992848c69862abbb/users/11aab6c2055f4f5fb3a12ef4990d5b08/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.501177 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591a621d5cc74617992848c69862abbb, user_id=11aab6c2055f4f5fb3a12ef4990d5b08, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.504089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5de9d-65d9-44d8-aa45-ba30c85faf44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.525124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1208/2417] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:16 2022] PUT /identity/v3/projects/591a621d5cc74617992848c69862abbb/users/11aab6c2055f4f5fb3a12ef4990d5b08/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:16.536028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.536576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.536783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.571787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] MFA Rules not processed for user `11aab6c2055f4f5fb3a12ef4990d5b08`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:16.573824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.577542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1210/2418] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:16 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:16.582567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.598950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b7ead-f4fd-474e-9247-a98cd3b6603c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.656988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1209/2419] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:16.669155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.672216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.675610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.676648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.677407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.677589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.678600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.680185 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.695833 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1211/2420] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:16.698035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.711046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a849f-4555-4165-95d1-8a564672a036 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.718101 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.718917 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.719206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.719484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.720503 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.722129 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.739560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1212/2421] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:16.740957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.749440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d813-3e63-45ab-8be5-be60ebd8149c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.754475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4f81c-faee-4371-9248-5303ad366c36 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.758511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.759748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.760161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.760513 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.767461 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.768513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.768796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.769241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] PATH_INFO: `/v3/projects/3fd0afcb81954e55b6dc20eacd43491a/users/7833c4ba243049b48f5220628df778b6/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.771108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.772667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.787660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1210/2422] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:16 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:16.796305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fd0afcb81954e55b6dc20eacd43491a, user_id=7833c4ba243049b48f5220628df778b6, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.799034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d32bc5-e2dc-4c86-89d6-1c6c72f823cc admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:16.865259 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:16.880536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b175-2fa6-4bb1-9445-0c8ca59804c6 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:16.882659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1213/2423] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:16 2022] PUT /identity/v3/projects/3fd0afcb81954e55b6dc20eacd43491a/users/7833c4ba243049b48f5220628df778b6/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:16.894571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.898348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.898348 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.934971 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] MFA Rules not processed for user `7833c4ba243049b48f5220628df778b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:16.937951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:16.962571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:16.963906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:16.964413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:16.964701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] PATH_INFO: `/v3/users/2682a1a6286143b9a3e6dda49fd2ac15` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:16.966245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2682a1a6286143b9a3e6dda49fd2ac15)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:16.968310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:17.024089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1214/2424] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:16 2022] POST /identity/v3/auth/tokens => generated 3419 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:17.032814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:17.100099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b76ed-b9be-4d7f-9f4f-e07810ee2f6a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:17.105314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:17.105994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:17.106272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:17.106542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:17.115586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:17.117078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d2b27-910b-4b4a-9058-1a9d17bfd2dd service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:17.126832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1215/2425] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3419 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:17.224935 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2682a1a6286143b9a3e6dda49fd2ac15'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:17.225748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2682a1a6286143b9a3e6dda49fd2ac15'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:17.237822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2682a1a6286143b9a3e6dda49fd2ac15'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:17.359371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2682a1a6286143b9a3e6dda49fd2ac15'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:17.377722 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2682a1a6286143b9a3e6dda49fd2ac15'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:17.386396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1211/2426] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:16 2022] DELETE /identity/v3/users/2682a1a6286143b9a3e6dda49fd2ac15 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:17.392276 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701edc-90ba-46ad-988b-c38963798672 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:17.392818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701edc-90ba-46ad-988b-c38963798672 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:17.392818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701edc-90ba-46ad-988b-c38963798672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:17.412742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-56701edc-90ba-46ad-988b-c38963798672 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:17.414072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-56701edc-90ba-46ad-988b-c38963798672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:17.482038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1216/2427] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:17 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:17.490277 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:17.492900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:17.556546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8155346-671c-48ae-9d14-b0be7c8f6db2 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:17.560435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:17.561085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:17.561372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:17.561653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:17.572598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:17.574050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:17.584605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1212/2428] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:17 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:18.058195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56701edc-90ba-46ad-988b-c38963798672 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:18.060715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-56701edc-90ba-46ad-988b-c38963798672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:18.087403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56701edc-90ba-46ad-988b-c38963798672 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:18.093779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:18.094656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:18.094943 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:18.095216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] PATH_INFO: `/v3/projects/e70486dd15f44d1da4eb6f992dc1fb3b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:18.096715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70486dd15f44d1da4eb6f992dc1fb3b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:18.098660 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:18.247382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70486dd15f44d1da4eb6f992dc1fb3b', 'request_id': 'req-63f5e046-7205-48cf-8dac-75a24e458a7a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.253240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70486dd15f44d1da4eb6f992dc1fb3b', 'request_id': 'req-63f5e046-7205-48cf-8dac-75a24e458a7a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.364673 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70486dd15f44d1da4eb6f992dc1fb3b', 'request_id': 'req-63f5e046-7205-48cf-8dac-75a24e458a7a'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.379371 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] The token cache is being invalidate because project e70486dd15f44d1da4eb6f992dc1fb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:18.379652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.380736 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.382368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1217/2429] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:18 2022] DELETE /identity/v3/projects/e70486dd15f44d1da4eb6f992dc1fb3b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:18.389670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:18.402614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888eda2-6248-4ada-8175-320877b4c61e service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:18.481861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:18.482432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:18.482715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:18.482993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] PATH_INFO: `/v3/users/11aab6c2055f4f5fb3a12ef4990d5b08` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:18.485562 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11aab6c2055f4f5fb3a12ef4990d5b08)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:18.491194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:18.706994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11aab6c2055f4f5fb3a12ef4990d5b08'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.707732 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11aab6c2055f4f5fb3a12ef4990d5b08'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.717058 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11aab6c2055f4f5fb3a12ef4990d5b08'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.798958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11aab6c2055f4f5fb3a12ef4990d5b08'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.814348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-62ee8538-c01b-4766-abf5-96765c8f20c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11aab6c2055f4f5fb3a12ef4990d5b08'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:18.821821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1213/2430] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:18 2022] DELETE /identity/v3/users/11aab6c2055f4f5fb3a12ef4990d5b08 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:19.359390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:19.360962 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:19.375436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e046-7205-48cf-8dac-75a24e458a7a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:19.448861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:19.449765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:19.450066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:19.450361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] PATH_INFO: `/v3/projects/591a621d5cc74617992848c69862abbb` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:19.451646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591a621d5cc74617992848c69862abbb)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:19.453653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:19.587793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591a621d5cc74617992848c69862abbb', 'request_id': 'req-ea8c37a7-e384-415a-b928-d6e0af935d32'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:19.593174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591a621d5cc74617992848c69862abbb', 'request_id': 'req-ea8c37a7-e384-415a-b928-d6e0af935d32'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:19.684524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591a621d5cc74617992848c69862abbb', 'request_id': 'req-ea8c37a7-e384-415a-b928-d6e0af935d32'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:19.695701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] The token cache is being invalidate because project 591a621d5cc74617992848c69862abbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:19.696053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:19.696685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ea8c37a7-e384-415a-b928-d6e0af935d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:19.698179 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1218/2431] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:19 2022] DELETE /identity/v3/projects/591a621d5cc74617992848c69862abbb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:19.703902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:19.704221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:19.704496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:19.722881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:19.724232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:19.783349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1214/2432] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:19.791961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:19.792280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:19.792702 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:19.811934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:19.813215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:19.821226 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1219/2433] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:19 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:19.825583 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:19.843697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecc6b-bc1d-425b-becb-b2ed68456ad0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:19.843697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:19.843697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:19.843697 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:19.844224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:19.844224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:19.844224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:19.844458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:19.856708 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1215/2434] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:19.861338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:19.871528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06cf28-9a8d-4f87-bafd-2ae9e4e30ea4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:19.876355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:19.876996 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:19.880548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:19.880548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:19.880548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:19.880548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:19.970923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1220/2435] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:19 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:19.975213 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:19.985897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecffeba-ac2c-40c3-9a72-03e404dba0d0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.041458 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.042176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.042504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.042787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.043473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.045422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.141208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1216/2436] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:19 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:20.145829 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.160566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0479f-3431-4a0c-b8fa-313011aac9a2 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.166942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.167772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.168095 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.168393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.169122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.170719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.184022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1221/2437] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:20.186200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.196648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb79d-639c-4048-8d7d-9fed9432319b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.201866 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.202531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.202823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.203128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.203845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.205452 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116372d-63aa-4683-9f13-5e3b8cf3c8be admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.216641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1217/2438] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:20.221143 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.237533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0000-b542-44e1-8fdf-5ad04f1e321e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.244881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.245763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.246047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.246319 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] PATH_INFO: `/v3/projects/61db238e5cce451aa72c9cf853ec26b9/users/853f0502d0034ce8bfbc7f5fb610c5f6/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.261684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61db238e5cce451aa72c9cf853ec26b9, user_id=853f0502d0034ce8bfbc7f5fb610c5f6, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.264324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.334705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1222/2439] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:20 2022] PUT /identity/v3/projects/61db238e5cce451aa72c9cf853ec26b9/users/853f0502d0034ce8bfbc7f5fb610c5f6/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:20.346735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.347021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.347297 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.376149 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] MFA Rules not processed for user `853f0502d0034ce8bfbc7f5fb610c5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:20.377364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:20.442256 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1218/2440] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:20 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:20.447208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.506243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361d19-dd7d-4a0b-b829-87b8c84aa8e4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.511855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.512558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.512876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.513157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.513864 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.515781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.617479 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1223/2441] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:20 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:20.624858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.636249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c624-e8e0-41c2-9135-96c2077bda61 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.698550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.699121 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.699403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.699679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.700401 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.702339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.793170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1219/2442] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:20 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:20.797173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.808229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afccf-36b6-446f-a925-518c29f3b53f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.812974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.813632 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.813919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.814249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.814951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.816585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.828208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1224/2443] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:20.832417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.842387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7859-2c78-4907-9e31-9f64d1fcf9b5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:20.847146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:20.848805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:20.848805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:20.848805 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] PATH_INFO: `/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd/users/6cd0c2f8892748dab8d86c83b5d30a04/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:20.863216 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc38a4615a9e40a9a964c0f88f9502cd, user_id=6cd0c2f8892748dab8d86c83b5d30a04, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:20.865959 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:20.969075 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1220/2444] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:20 2022] PUT /identity/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd/users/6cd0c2f8892748dab8d86c83b5d30a04/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:20.969263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:20.977686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdfbfc-19fd-4e23-92ef-e74dba65695c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:21.033412 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:21.034077 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:21.034457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:21.034790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:21.035429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:21.037050 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c395db-b9eb-4586-ae4e-a89fb1e77d15 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:21.047096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1225/2445] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:21.051487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:21.062742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032495ac-bf6e-4faa-8b30-5f23f2cbaa44 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:21.067603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:21.068444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:21.068727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:21.069010 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] PATH_INFO: `/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd/users/6cd0c2f8892748dab8d86c83b5d30a04/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:21.071006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc38a4615a9e40a9a964c0f88f9502cd, user_id=6cd0c2f8892748dab8d86c83b5d30a04, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:21.073670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:21.083774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1221/2446] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:21 2022] PUT /identity/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd/users/6cd0c2f8892748dab8d86c83b5d30a04/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:21.094407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:21.094691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:21.094965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:21.122866 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] MFA Rules not processed for user `6cd0c2f8892748dab8d86c83b5d30a04`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:21.131069 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:21.191691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1226/2447] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:21 2022] POST /identity/v3/auth/tokens => generated 3466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:21.203224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:21.204906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:21.261487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5687e3e-d7ad-4f7f-894b-d8d93012d7fd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:21.265148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:21.265774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:21.266052 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:21.266431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:21.275553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:21.277188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:21.286713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1222/2448] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:21 2022] GET /identity/v3/auth/tokens => generated 3466 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:21.797542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:21.807665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be670a25-217a-475a-aa6c-fc9f2519963b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:21.811411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:21.817294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:21.817294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:21.817294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:21.817294 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:21.880011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:21.881340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:21.890779 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1227/2449] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:21 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:22.350226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:22.360185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ff4f-98e0-463e-abda-6d308ea83184 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:22.365079 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd0c2f8892748dab8d86c83b5d30a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc38a4615a9e40a9a964c0f88f9502cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:22.365720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:22.366007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:22.366291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:22.367002 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:22.367310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:22.369057 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:22.380418 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1223/2450] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:22.384667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:22.402508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2108292-102a-4480-9cb7-df819300b02a service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:22.402508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd0c2f8892748dab8d86c83b5d30a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc38a4615a9e40a9a964c0f88f9502cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:22.402508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:22.402893 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:22.402984 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:22.403655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:22.405657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:22.551491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1228/2451] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:22 2022] POST /identity/v3/projects => generated 354 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:22.553181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:22.564191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3d28-84e8-4e29-9e80-5a2fd2b61402 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:22.627804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd0c2f8892748dab8d86c83b5d30a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc38a4615a9e40a9a964c0f88f9502cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:22.628525 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:22.628815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:22.633038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:22.633038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:22.633038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:22.633038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:22.645625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1224/2452] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:11:22.684117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:22.695017 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4584bc-4a31-4734-a769-46ac2f513c13 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:22.700553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cd0c2f8892748dab8d86c83b5d30a04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc38a4615a9e40a9a964c0f88f9502cd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:22.701458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:22.701748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:22.702027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] PATH_INFO: `/v3/projects/0843e3fc1a2d47b980152a17f583dac8` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:22.703286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0843e3fc1a2d47b980152a17f583dac8)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:22.705278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:22.835611 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0843e3fc1a2d47b980152a17f583dac8', 'request_id': 'req-84afa0d7-a349-470b-8b85-dc3ebe6d6191'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:22.841862 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0843e3fc1a2d47b980152a17f583dac8', 'request_id': 'req-84afa0d7-a349-470b-8b85-dc3ebe6d6191'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:22.930633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0843e3fc1a2d47b980152a17f583dac8', 'request_id': 'req-84afa0d7-a349-470b-8b85-dc3ebe6d6191'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:22.944979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] The token cache is being invalidate because project 0843e3fc1a2d47b980152a17f583dac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:22.945367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:22.946117 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84afa0d7-a349-470b-8b85-dc3ebe6d6191 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:22.948691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1229/2453] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:22 2022] DELETE /identity/v3/projects/0843e3fc1a2d47b980152a17f583dac8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:23.537602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:23.539469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:23.606973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2412ef-1eb8-4b25-a761-f7fb9ddbd8e9 tempest-VolumeQuotaClassesTest-570338948 tempest-VolumeQuotaClassesTest-570338948-project-admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:23.670068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:23.670937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:23.671225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:23.671500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] PATH_INFO: `/v3/users/853f0502d0034ce8bfbc7f5fb610c5f6` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:23.672736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853f0502d0034ce8bfbc7f5fb610c5f6)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:23.674642 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:23.886650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853f0502d0034ce8bfbc7f5fb610c5f6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:23.887364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853f0502d0034ce8bfbc7f5fb610c5f6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:23.894357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853f0502d0034ce8bfbc7f5fb610c5f6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:23.993232 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853f0502d0034ce8bfbc7f5fb610c5f6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.006152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853f0502d0034ce8bfbc7f5fb610c5f6'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.012453 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1225/2454] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:23 2022] DELETE /identity/v3/users/853f0502d0034ce8bfbc7f5fb610c5f6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:24.016884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:24.017389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:24.017549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:24.037066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:24.038051 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:24.100749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1230/2455] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:24 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:24.111038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:24.112602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:24.172221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e5b0c-ce1b-4e68-ba02-ede7ad17b3e1 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:24.175825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:24.176485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:24.176765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:24.177036 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:24.185939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:24.187289 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:24.197191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1226/2456] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:24 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:24.686655 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:24.688497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:24.703538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86cd7a-c562-478d-8437-58bdfb00aef2 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:24.708356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:24.709638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:24.709638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:24.709898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] PATH_INFO: `/v3/projects/61db238e5cce451aa72c9cf853ec26b9` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:24.710993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61db238e5cce451aa72c9cf853ec26b9)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:24.713788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:24.866497 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61db238e5cce451aa72c9cf853ec26b9', 'request_id': 'req-14c423d8-c8d1-4bea-a908-9ef534aa51a1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.872443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61db238e5cce451aa72c9cf853ec26b9', 'request_id': 'req-14c423d8-c8d1-4bea-a908-9ef534aa51a1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.935566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61db238e5cce451aa72c9cf853ec26b9', 'request_id': 'req-14c423d8-c8d1-4bea-a908-9ef534aa51a1'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.948182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] The token cache is being invalidate because project 61db238e5cce451aa72c9cf853ec26b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:24.948522 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.949177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:24.950821 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1231/2457] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:24 2022] DELETE /identity/v3/projects/61db238e5cce451aa72c9cf853ec26b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:24.954898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:24.965376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e907c0c-6775-4109-9684-fd4c2cc772a3 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:25.018875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:25.019723 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:25.020029 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:25.020306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] PATH_INFO: `/v3/users/6cd0c2f8892748dab8d86c83b5d30a04` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:25.021487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd0c2f8892748dab8d86c83b5d30a04)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:25.023384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:25.199227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd0c2f8892748dab8d86c83b5d30a04'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:25.199896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd0c2f8892748dab8d86c83b5d30a04'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:25.208200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd0c2f8892748dab8d86c83b5d30a04'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:25.289883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd0c2f8892748dab8d86c83b5d30a04'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:25.302896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7728a0f8-689f-4c08-a129-e6850ee8253f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd0c2f8892748dab8d86c83b5d30a04'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:25.309735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1227/2458] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:24 2022] DELETE /identity/v3/users/6cd0c2f8892748dab8d86c83b5d30a04 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:25.799871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:25.806815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:25.817186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c423d8-c8d1-4bea-a908-9ef534aa51a1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:25.881381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:25.887212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:25.887212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:25.887212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] PATH_INFO: `/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:25.887212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc38a4615a9e40a9a964c0f88f9502cd)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:25.887212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:25.995420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc38a4615a9e40a9a964c0f88f9502cd', 'request_id': 'req-b1d7b507-574f-4516-bf38-9d42eb1e5702'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.001600 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc38a4615a9e40a9a964c0f88f9502cd', 'request_id': 'req-b1d7b507-574f-4516-bf38-9d42eb1e5702'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.090283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc38a4615a9e40a9a964c0f88f9502cd', 'request_id': 'req-b1d7b507-574f-4516-bf38-9d42eb1e5702'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.102327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] The token cache is being invalidate because project dc38a4615a9e40a9a964c0f88f9502cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:26.102620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.104024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b1d7b507-574f-4516-bf38-9d42eb1e5702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.105701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1232/2459] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:25 2022] DELETE /identity/v3/projects/dc38a4615a9e40a9a964c0f88f9502cd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:26.111841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.112332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.112550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.130990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:26.132218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.198243 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1228/2460] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:26.207181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832118-9bae-4864-8f65-c93ec216394a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.207563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832118-9bae-4864-8f65-c93ec216394a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.208333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832118-9bae-4864-8f65-c93ec216394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.229260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-db832118-9bae-4864-8f65-c93ec216394a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:26.230485 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-db832118-9bae-4864-8f65-c93ec216394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.239731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1233/2461] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:26.247897 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.258146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603e8e-ef6f-4207-9f53-6fd2352c78f9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.265498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.266672 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.267306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.267726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.268882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:26.272731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.272731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.284590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1229/2462] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:26.288763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832118-9bae-4864-8f65-c93ec216394a None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.300892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832118-9bae-4864-8f65-c93ec216394a None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.307636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.308551 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.308897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.309240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.310035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.312001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.393470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1234/2463] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:26.397799 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.409077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1040f-71c1-4b8b-89bc-9b6a7d31b2f6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.433692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.436504 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.482321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.483007 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.483347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.483626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.484383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.486456 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.522246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca6bd-50e0-4a71-9580-442646ee31b7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.528424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.529312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.530608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.530930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] PATH_INFO: `/v3/users/7833c4ba243049b48f5220628df778b6` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.532557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7833c4ba243049b48f5220628df778b6)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.534283 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.617222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1230/2464] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:26.621756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.621756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.701882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22e1af-e674-4d4a-908a-3b975e3e2e7b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.707620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.708314 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.708595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.708882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.710685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.725761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.727341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.738365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1231/2465] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:26 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:26.739179 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.751208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250633-b4c3-42e2-909f-6af90527810e service nova] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.758305 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.758926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.759301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.759661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.760437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.762051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.783566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7833c4ba243049b48f5220628df778b6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.788661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1232/2466] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:26.790145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.793904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7833c4ba243049b48f5220628df778b6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.802464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8573977-ebd3-41b8-91f6-eaf0b61e5ef0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.809045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.809857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.810143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.810425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.814035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.814035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.814380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7833c4ba243049b48f5220628df778b6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.826267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1233/2467] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:26.830591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:26.842114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea5c55-c9a3-4251-81fe-63b3b9b216b4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:26.854006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:26.854006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.854006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.854006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] PATH_INFO: `/v3/projects/55aa2ebd62fb4d05ba3f1e1c1672dff0/users/23fb652a80334dc2bbc6648106c09362/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.870410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55aa2ebd62fb4d05ba3f1e1c1672dff0, user_id=23fb652a80334dc2bbc6648106c09362, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:26.873128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d47779-bfca-4ad6-88b4-af16181c5edf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:26.918653 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7833c4ba243049b48f5220628df778b6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.919646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8d97a03b-87e9-4929-88f2-a6ca3396cfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7833c4ba243049b48f5220628df778b6'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:26.926801 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1235/2468] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:26 2022] DELETE /identity/v3/users/7833c4ba243049b48f5220628df778b6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:26.931289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.933224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.933224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:26.952562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:26.954355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:26.968649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1234/2469] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:26 2022] PUT /identity/v3/projects/55aa2ebd62fb4d05ba3f1e1c1672dff0/users/23fb652a80334dc2bbc6648106c09362/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:26.971560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:26.971838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:26.972166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.003785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] MFA Rules not processed for user `23fb652a80334dc2bbc6648106c09362`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:27.005120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.027287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1236/2470] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:27.038257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.040298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.089280 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1235/2471] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:26 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:27.093868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.095355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.102471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52258af2-d27e-4ff4-9356-d6c3925999b2 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.107011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.107731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.108063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.108343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.110237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df5909-6911-4871-93ab-9c339db9e379 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.115051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.115818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.116222 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.116599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.117344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.119441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.120450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.121113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.138317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1237/2472] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:27.297293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1236/2473] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:27 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:27.301969 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.317124 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7d15a-b9b5-43f0-b03c-40eb7085e58f service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.391620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.392351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.392636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.392919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.393701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.396968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.482292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1238/2474] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:27 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:27.486626 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.501394 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7c530-fba9-4e21-86b7-c4e2cbd6ebd3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.507096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.508040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.508334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.508614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.509446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.511225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.526128 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1237/2475] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:27.530715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.542253 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a857e-7cf5-4d13-825e-045cfeab7f78 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.549042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.553765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.553765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.553765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] PATH_INFO: `/v3/projects/13330ff45151465b8608010f0c2891c2/users/8f405ae394fb4f74bf590c45f7defbf0/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.567767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13330ff45151465b8608010f0c2891c2, user_id=8f405ae394fb4f74bf590c45f7defbf0, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.570628 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.644145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1239/2476] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:27 2022] PUT /identity/v3/projects/13330ff45151465b8608010f0c2891c2/users/8f405ae394fb4f74bf590c45f7defbf0/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:27.648155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.659482 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da6f4-a55f-4d38-9459-8cbe96d4dee9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.677207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.679904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.734367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.742861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.742861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.742861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.742861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.742861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.751706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1238/2477] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:27.755819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.765577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d145402-c695-45d0-86af-85be8ae52d57 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.767610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355e1cb-1c0a-4cdf-8c05-a95922b0a19f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:27.770547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.771400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.771703 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.771958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] PATH_INFO: `/v3/projects/3fd0afcb81954e55b6dc20eacd43491a` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.772271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:27.773134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.773257 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fd0afcb81954e55b6dc20eacd43491a)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.773412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.773686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] PATH_INFO: `/v3/projects/13330ff45151465b8608010f0c2891c2/users/8f405ae394fb4f74bf590c45f7defbf0/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.775662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.776534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13330ff45151465b8608010f0c2891c2, user_id=8f405ae394fb4f74bf590c45f7defbf0, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:27.779142 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292967ac-57eb-4287-96a4-ba47be717045 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:27.792336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1239/2478] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:27 2022] PUT /identity/v3/projects/13330ff45151465b8608010f0c2891c2/users/8f405ae394fb4f74bf590c45f7defbf0/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:27.807763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:27.808077 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:27.808357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:27.835710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] MFA Rules not processed for user `8f405ae394fb4f74bf590c45f7defbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:27.836941 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.908923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fd0afcb81954e55b6dc20eacd43491a', 'request_id': 'req-83b01ea8-1111-48fa-b2a7-c87d135902ba'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:27.910282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1240/2479] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:27 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:27.914646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fd0afcb81954e55b6dc20eacd43491a', 'request_id': 'req-83b01ea8-1111-48fa-b2a7-c87d135902ba'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:27.920443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:27.921784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:27.979659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16419564-40ff-4600-beb8-814f1aecdbc8 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.025966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.026606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.026884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.027060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fd0afcb81954e55b6dc20eacd43491a', 'request_id': 'req-83b01ea8-1111-48fa-b2a7-c87d135902ba'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:28.027170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.038409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] The token cache is being invalidate because project 3fd0afcb81954e55b6dc20eacd43491a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:28.038694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:28.039346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-83b01ea8-1111-48fa-b2a7-c87d135902ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:28.041557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1240/2480] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:27 2022] DELETE /identity/v3/projects/3fd0afcb81954e55b6dc20eacd43491a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:28.053884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.054175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.054456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.074061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:28.075268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:28.086013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.088101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e877-6b3c-4b41-a96b-7240ba6fa60c service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.097861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1241/2481] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:27 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:28.142656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1241/2482] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:28.150889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.151597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.151597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.169321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:28.170520 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:28.179291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1242/2483] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:28.183315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.193652 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e28e-3961-48dd-bb22-8a9ca84b4369 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.199499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.200173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.200293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.200469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.200740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.201493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:28.201599 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:28.201795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.203400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.214123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747abc6-1c0e-440b-beab-f32126968a8d None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.219680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1242/2484] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:28.219818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.219818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.219818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.219818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.221118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.221588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:28.231188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef476c7-b6ec-4ecb-b581-133a0e98b129 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.235803 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.236476 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.236824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.237233 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.237920 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.239790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.281009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.282469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.291485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1243/2485] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:28 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:28.348752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1243/2486] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:28 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:28.354985 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.372638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018be849-face-4523-b6b0-ed034799e61c service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.435699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.436396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.436676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.436948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.437633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.439615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.560129 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1244/2487] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:28 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:28.564097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.575244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c908-0f96-4251-87e0-2b44a1190068 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.579825 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.580499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.580782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.581059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.581772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.583521 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.593463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1244/2488] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:28.600043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.610237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d4574-3faa-47ac-a185-dfbf32b51170 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.615835 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.616534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.616821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.617094 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.617814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.620293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ea7d9-2d42-4e1e-8035-887eef207bc3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.631431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1245/2489] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:28.641740 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.653445 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6c427-eac5-495e-b618-775dc7ab2d1f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:28.660159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:28.661406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.661696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.662002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] PATH_INFO: `/v3/projects/7ed8db325d13496c9a417966e33b10a1/users/4cdbf7d369e4437eae7a36529d6cd623/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.680759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed8db325d13496c9a417966e33b10a1, user_id=4cdbf7d369e4437eae7a36529d6cd623, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:28.684303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:28.835061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1245/2490] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:28 2022] PUT /identity/v3/projects/7ed8db325d13496c9a417966e33b10a1/users/4cdbf7d369e4437eae7a36529d6cd623/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:28.848608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:28.848899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:28.849181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:28.869324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:28.870536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:28.931709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1246/2491] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:28 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:28.942583 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:28.945244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:29.007665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1ea6f-2858-4954-876b-12b8e03c8ce5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:29.011681 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:29.012364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:29.012634 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:29.012907 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:29.028568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:29.030327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310ab28-f090-4569-acb3-fcc9f1791644 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:29.042293 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1246/2492] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:28 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:31.728392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:31.730173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:31.745558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df86fba-5ced-48da-b45a-964acc98c6fd None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:31.785589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:31.787240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:31.787537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:31.787825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] PATH_INFO: `/v3/users/23fb652a80334dc2bbc6648106c09362` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:31.800050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fb652a80334dc2bbc6648106c09362)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:31.800050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:32.058546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fb652a80334dc2bbc6648106c09362'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:32.059127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fb652a80334dc2bbc6648106c09362'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:32.066270 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fb652a80334dc2bbc6648106c09362'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:32.130363 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fb652a80334dc2bbc6648106c09362'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:32.152269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fb652a80334dc2bbc6648106c09362'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:32.160674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1247/2493] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:31 2022] DELETE /identity/v3/users/23fb652a80334dc2bbc6648106c09362 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:32.165278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:32.165818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:32.166254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:32.185776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:32.187167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:32.254423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1247/2494] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:32 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:32.273530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:32.278712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:32.349558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c4844-a075-4193-8e4d-5339f95f4bcb admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:32.353421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:32.354863 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:32.355368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:32.355711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:32.366227 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:32.367785 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330a5f-5124-467a-80d7-91ca091a19f0 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:32.378874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1248/2495] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:32 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:33.113558 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:33.114978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:33.127388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a5f5-6024-4561-a90c-9d5177858bda None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:33.143457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:33.143457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:33.143457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:33.145280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] PATH_INFO: `/v3/projects/55aa2ebd62fb4d05ba3f1e1c1672dff0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:33.146258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55aa2ebd62fb4d05ba3f1e1c1672dff0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:33.148239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:33.273334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55aa2ebd62fb4d05ba3f1e1c1672dff0', 'request_id': 'req-26904955-222d-46ce-8c4b-2e938eb07f33'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.279397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55aa2ebd62fb4d05ba3f1e1c1672dff0', 'request_id': 'req-26904955-222d-46ce-8c4b-2e938eb07f33'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.331693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55aa2ebd62fb4d05ba3f1e1c1672dff0', 'request_id': 'req-26904955-222d-46ce-8c4b-2e938eb07f33'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.333205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:33.334000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:33.348239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:33.348420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] The token cache is being invalidate because project 55aa2ebd62fb4d05ba3f1e1c1672dff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:33.348420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.348420 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.350092 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1248/2496] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:33 2022] DELETE /identity/v3/projects/55aa2ebd62fb4d05ba3f1e1c1672dff0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:33.354330 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:33.354912 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] MFA Rules not processed for user `acab2a0c4a0e48909317791a3de85b53`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:33.356322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:33.357106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:33.420425 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1249/2497] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:33 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:33.439031 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26904955-222d-46ce-8c4b-2e938eb07f33 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:33.444379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:33.445561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:33.445949 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:33.446327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] PATH_INFO: `/v3/users/8f405ae394fb4f74bf590c45f7defbf0` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:33.449142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f405ae394fb4f74bf590c45f7defbf0)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:33.451435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:33.631778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f405ae394fb4f74bf590c45f7defbf0'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.643876 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f405ae394fb4f74bf590c45f7defbf0'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.661641 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f405ae394fb4f74bf590c45f7defbf0'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.713837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f405ae394fb4f74bf590c45f7defbf0'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.714675 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f405ae394fb4f74bf590c45f7defbf0'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:33.727370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1249/2498] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:33 2022] DELETE /identity/v3/users/8f405ae394fb4f74bf590c45f7defbf0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:33.825955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:33.827397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:33.913009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbbbaa-3ae2-467e-989a-907fba0dd137 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:33.973955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:33.974796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:33.975081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:33.975537 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:33.977634 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:33.989506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:33.992334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:34.001455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1250/2499] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:34.361094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:34.362646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:34.413460 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:34.415285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:34.457194 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4293d2f-d2b3-45b6-894f-b10af7d83c52 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:34.462395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:34.465633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.466291 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.466800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] PATH_INFO: `/v3/projects/13330ff45151465b8608010f0c2891c2` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.469511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13330ff45151465b8608010f0c2891c2)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:34.471916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:34.524671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2963-453d-46b3-b536-e5baf6fbdade service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:34.544080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:34.544080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.544080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.544080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.544532 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:34.556354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:34.558186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877ff4-0d61-49ab-b589-9effc26f9f7b service placement] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:34.570275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1251/2500] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:34 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:34.618729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13330ff45151465b8608010f0c2891c2', 'request_id': 'req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:34.627085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13330ff45151465b8608010f0c2891c2', 'request_id': 'req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:34.707684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13330ff45151465b8608010f0c2891c2', 'request_id': 'req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:34.721788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] The token cache is being invalidate because project 13330ff45151465b8608010f0c2891c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:34.722507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:34.723394 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-ac84a8cc-0c16-4c59-bc24-60171cca8c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:34.728043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1250/2501] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:34 2022] DELETE /identity/v3/projects/13330ff45151465b8608010f0c2891c2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:34.733408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.733701 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.733988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.753540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:34.755030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:34.837190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1252/2502] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:34.843328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.843328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.843328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.862999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:34.864587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:34.874719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1251/2503] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:34 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:34.879168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:34.890814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a0da-e900-49f2-bd1e-f61d56cbce16 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:34.895782 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:34.896421 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.896709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.896990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.897739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:34.898049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:34.899778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:34.916435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1253/2504] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:34.919613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:34.929728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c239c0-5a0b-4965-b6c8-9c9911b4835b None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:34.937745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:34.937745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:34.937745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:34.937745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:34.938149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:34.939597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.074875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1252/2505] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:34 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:35.079424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.094099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e8594-3f43-4d87-b0cc-13b7e84eef88 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.187354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.188946 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.189430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.189711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.190899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.192968 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.323839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1254/2506] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:35.329865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.343410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935e782-20cf-4a07-b4a3-05aeda084b8a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.354671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.356244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.356395 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.356666 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.358027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.360044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.372705 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1253/2507] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:35.377793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.396014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72383e1e-98d1-43bb-8b7d-943c2570987b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.407131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.407131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.407131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.407131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.407516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.407516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6def86-8732-4ab0-814e-23b57f1da7c5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.421715 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1255/2508] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:35.426494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.461326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8381baa-8a7c-4406-a6f2-01e69e2194a5 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.477901 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.479290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.479574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.479848 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] PATH_INFO: `/v3/projects/e33ff28b70124d509e206f5a33e9cdc7/users/b03855effcce4f6e8df0b345d5f1e79e/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.500565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33ff28b70124d509e206f5a33e9cdc7, user_id=b03855effcce4f6e8df0b345d5f1e79e, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.511433 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.558561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0efa8-5486-44bc-bedc-2a222dbd2169 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.559042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0efa8-5486-44bc-bedc-2a222dbd2169 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.559332 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0efa8-5486-44bc-bedc-2a222dbd2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.600108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-0de0efa8-5486-44bc-bedc-2a222dbd2169 None None] MFA Rules not processed for user `4cdbf7d369e4437eae7a36529d6cd623`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:35.602250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0de0efa8-5486-44bc-bedc-2a222dbd2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:35.676060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1254/2509] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:35 2022] PUT /identity/v3/projects/e33ff28b70124d509e206f5a33e9cdc7/users/b03855effcce4f6e8df0b345d5f1e79e/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:35.676249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1256/2510] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:35.680682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.682846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:35.685861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.686154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.686435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.718653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] MFA Rules not processed for user `b03855effcce4f6e8df0b345d5f1e79e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:35.720050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:35.755986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81b096-1ec7-48f7-a992-ed37a662f3a9 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.761413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.762085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.762372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.762648 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.763344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.765462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.793377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1257/2511] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:35.797875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.809674 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1548a8e-7641-42f0-b376-efc922876e7c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:35.814445 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:35.815182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:35.815470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:35.815744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:35.816474 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:35.818393 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:35.897397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1255/2512] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:35.902078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.923804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1258/2513] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:35.928098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:35.979767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f37e-bdae-4f0e-93bd-a8ad0e505d9b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.009311 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560779a3-4402-469a-ae4b-e52bb0882c2d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.017127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.017857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.018136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.018414 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.019125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.021217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.053353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.054033 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.054314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.054587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.055307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.057286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.102286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1259/2514] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:36.109138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.124336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab046e-b150-49d3-8653-b8e330b32668 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.130471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.136151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.136151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.136151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.136753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1256/2515] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:35 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:11:36.137013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.138675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.140177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.153354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb58c-5402-4e22-b943-593137b4d8c1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.159899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1260/2516] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:36.160114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.160114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.160114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.160114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.160793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.162626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.164097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.177668 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1257/2517] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:36.177885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6e13-c744-42f1-a7eb-cf19e646fd66 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.179215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.180343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.181356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.181671 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.181947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] PATH_INFO: `/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d/users/0960eabdc7e34d3293741110ff6c02cb/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.189444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f539a3-dc09-4cab-94d7-dd4b23dcb81e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.194355 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.195284 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.195566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.195839 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] PATH_INFO: `/v3/projects/241a59488666455e8498e7c5010fa09f/users/60d52bb66a004c7b876fafb221d6cb0d/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.198688 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c075559ee7d94b5e9a6ba17fd6c94a3d, user_id=0960eabdc7e34d3293741110ff6c02cb, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.201446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.212533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241a59488666455e8498e7c5010fa09f, user_id=60d52bb66a004c7b876fafb221d6cb0d, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.215867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.294358 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1261/2518] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:36 2022] PUT /identity/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d/users/0960eabdc7e34d3293741110ff6c02cb/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:36.298412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.330498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1258/2519] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:36 2022] PUT /identity/v3/projects/241a59488666455e8498e7c5010fa09f/users/60d52bb66a004c7b876fafb221d6cb0d/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:36.335333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.360530 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e909a9-d60a-41af-beb1-fe2b42b57fbd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.403995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1dd31-a1d6-46b2-894a-d1f6b32ac6d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.409159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.409894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.410246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.410528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.411242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.412942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.423598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1259/2520] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:36.424384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.425125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.425479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.425829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.426624 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.428024 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.428337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.438616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d0305-feed-4fb9-83e6-02e4c08cba6d admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.442199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1262/2521] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:11:36.443201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.447760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.447760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.447760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.447760 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] PATH_INFO: `/v3/projects/241a59488666455e8498e7c5010fa09f/users/60d52bb66a004c7b876fafb221d6cb0d/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.448224 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=241a59488666455e8498e7c5010fa09f, user_id=60d52bb66a004c7b876fafb221d6cb0d, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.451300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798743-5783-4be8-ab8c-63fb2e64ee2c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.453826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dd8ff-64db-49c8-aad8-d91da7841dad admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.458567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.459417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.459705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.460004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] PATH_INFO: `/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d/users/0960eabdc7e34d3293741110ff6c02cb/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.461560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1260/2522] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:36 2022] PUT /identity/v3/projects/241a59488666455e8498e7c5010fa09f/users/60d52bb66a004c7b876fafb221d6cb0d/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:36.465918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c075559ee7d94b5e9a6ba17fd6c94a3d, user_id=0960eabdc7e34d3293741110ff6c02cb, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.465918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.476118 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1263/2523] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:36 2022] PUT /identity/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d/users/0960eabdc7e34d3293741110ff6c02cb/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:36.487842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.487842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.488110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.515636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] MFA Rules not processed for user `0960eabdc7e34d3293741110ff6c02cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:36.516904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:36.583175 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1261/2524] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:36 2022] POST /identity/v3/auth/tokens => generated 3474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:36.593492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:36.596873 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:36.676464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91db4-3094-41e7-b62b-19e6d20c5208 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:36.680329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:36.680980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:36.682253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:36.682253 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:36.695535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:36.696615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f6c6f-2900-4089-96ea-157169ba8d6a service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:36.708061 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1264/2525] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:36 2022] GET /identity/v3/auth/tokens => generated 3474 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:11:38.143258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:38.302694 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d032470-fc62-4a33-97b3-1d7a0f8e4923 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:38.313542 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:38.314757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:38.315148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:38.315526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] PATH_INFO: `/v3/users/b03855effcce4f6e8df0b345d5f1e79e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:38.317784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03855effcce4f6e8df0b345d5f1e79e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:38.323527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:38.553635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03855effcce4f6e8df0b345d5f1e79e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:38.565094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03855effcce4f6e8df0b345d5f1e79e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:38.587100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03855effcce4f6e8df0b345d5f1e79e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:38.720256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03855effcce4f6e8df0b345d5f1e79e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:38.722983 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03855effcce4f6e8df0b345d5f1e79e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:38.733979 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1262/2526] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:38 2022] DELETE /identity/v3/users/b03855effcce4f6e8df0b345d5f1e79e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:38.738736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:38.739882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:38.740523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:38.783026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:38.784748 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:38.906108 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1265/2527] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:38 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:38.922398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:38.924254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:39.082955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263ac7a-fb70-42d3-b016-6a0331e04b9c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:39.091506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:39.093273 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:39.093776 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:39.094242 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:39.111753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:39.113547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:39.138744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1263/2528] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:38 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:40.432542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:40.436845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:40.461895 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510068-75d2-4848-8a42-f2182135b984 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:40.506448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:40.507350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:40.510248 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:40.510538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] PATH_INFO: `/v3/projects/e33ff28b70124d509e206f5a33e9cdc7` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:40.514699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33ff28b70124d509e206f5a33e9cdc7)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:40.516653 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:40.709049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33ff28b70124d509e206f5a33e9cdc7', 'request_id': 'req-5122b0c5-4298-430a-9b36-8ff88134e390'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:40.718164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33ff28b70124d509e206f5a33e9cdc7', 'request_id': 'req-5122b0c5-4298-430a-9b36-8ff88134e390'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:40.827424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33ff28b70124d509e206f5a33e9cdc7', 'request_id': 'req-5122b0c5-4298-430a-9b36-8ff88134e390'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:40.847745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] The token cache is being invalidate because project e33ff28b70124d509e206f5a33e9cdc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:40.849594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:40.850591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:40.858186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:40.870308 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1266/2529] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:40 2022] DELETE /identity/v3/projects/e33ff28b70124d509e206f5a33e9cdc7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:40.897885 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b6a0-a1d4-442c-99bb-4a9cb73bd95e service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:41.058011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:41.061060 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:41.061386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:41.061710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] PATH_INFO: `/v3/users/0960eabdc7e34d3293741110ff6c02cb` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:41.075192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0960eabdc7e34d3293741110ff6c02cb)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:41.075192 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:41.378716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0960eabdc7e34d3293741110ff6c02cb'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:41.399510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0960eabdc7e34d3293741110ff6c02cb'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:41.431085 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0960eabdc7e34d3293741110ff6c02cb'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:41.536571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0960eabdc7e34d3293741110ff6c02cb'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:41.537450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0960eabdc7e34d3293741110ff6c02cb'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:41.545837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1264/2530] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:40 2022] DELETE /identity/v3/users/0960eabdc7e34d3293741110ff6c02cb => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:42.422689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:42.422689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:42.434317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122b0c5-4298-430a-9b36-8ff88134e390 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:42.515284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:42.516516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:42.516876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:42.517221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] PATH_INFO: `/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:42.518521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c075559ee7d94b5e9a6ba17fd6c94a3d)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:42.520540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:42.605174 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:42.607382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:42.662942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c075559ee7d94b5e9a6ba17fd6c94a3d', 'request_id': 'req-17255cac-57b2-464b-b20f-0399c22fd41f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:42.678275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c075559ee7d94b5e9a6ba17fd6c94a3d', 'request_id': 'req-17255cac-57b2-464b-b20f-0399c22fd41f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:42.703112 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2269-3098-490e-81a7-393558d717d1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:42.776238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c075559ee7d94b5e9a6ba17fd6c94a3d', 'request_id': 'req-17255cac-57b2-464b-b20f-0399c22fd41f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:42.791544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] The token cache is being invalidate because project c075559ee7d94b5e9a6ba17fd6c94a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:42.791844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:42.793825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-17255cac-57b2-464b-b20f-0399c22fd41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:42.794629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:42.796762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:42.797473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:42.797824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:42.799945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1267/2531] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:42 2022] DELETE /identity/v3/projects/c075559ee7d94b5e9a6ba17fd6c94a3d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:42.805577 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:42.805821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:42.806114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:42.806420 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:42.836737 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:42.840824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba2cc-2e59-44dd-887f-f2bda18ef017 service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:42.851795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:42.854198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:42.872473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1265/2532] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:42 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:42.944387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1268/2533] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:42.950805 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582504f-d694-4741-b7b8-608e509e011d None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:42.951955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582504f-d694-4741-b7b8-608e509e011d None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:42.952396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582504f-d694-4741-b7b8-608e509e011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:42.981363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e582504f-d694-4741-b7b8-608e509e011d None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:42.982986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e582504f-d694-4741-b7b8-608e509e011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:42.999898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1266/2534] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:43.006864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.032102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca4116-0380-4855-8efb-9845ef567d55 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.037132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.038042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.038422 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.038920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.039821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:11:43.040268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.043147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.059435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1269/2535] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:11:43.063824 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582504f-d694-4741-b7b8-608e509e011d None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.086472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582504f-d694-4741-b7b8-608e509e011d None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.097966 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.099156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.099729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.100151 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.101762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.104597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.283950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1267/2536] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:11:43 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:43.289821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.303541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8ffab-7e9c-4356-8776-45f82c91fcb8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.412190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.413339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.413904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.414194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.414942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.419183 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.542756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1270/2537] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:11:43 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:11:43.547586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.562879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574cb3-5f74-49f9-9c3c-2d2d6d1c425c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.574924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.576398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.576861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.578841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.580172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.583636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.608028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1268/2538] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:43.610880 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.622159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fb6e-ac0a-4204-8ba0-abb639cd2d86 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.627317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.628001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.628323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.628780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.629517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.631201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b657cf7-1d26-41b4-af52-13fa5b3028c8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.644030 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1271/2539] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:11:43.648400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.660619 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861dd00-757e-43d8-853b-ebfc2c57d521 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:43.668264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:43.672216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.672438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.672700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] PATH_INFO: `/v3/projects/027d34c5c8f44a64acbf7caba82fbac9/users/d617a790490a439e9025e8b60cd5b8a7/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.701177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] RBAC: Authorizing `identity:create_grant(project_id=027d34c5c8f44a64acbf7caba82fbac9, user_id=d617a790490a439e9025e8b60cd5b8a7, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:43.709762 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:43.793155 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1269/2540] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:11:43 2022] PUT /identity/v3/projects/027d34c5c8f44a64acbf7caba82fbac9/users/d617a790490a439e9025e8b60cd5b8a7/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:43.803473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca1e2-5b1a-4739-b289-1c39c0a93bdd None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:43.804034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca1e2-5b1a-4739-b289-1c39c0a93bdd None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:43.804446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ca1e2-5b1a-4739-b289-1c39c0a93bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:43.843566 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-691ca1e2-5b1a-4739-b289-1c39c0a93bdd None None] MFA Rules not processed for user `d617a790490a439e9025e8b60cd5b8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:43.860736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-691ca1e2-5b1a-4739-b289-1c39c0a93bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:43.922272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1272/2541] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:43 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:43.934203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:43.936002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:44.043724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556ba07-744c-47c4-a35e-50435c00030b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:44.047958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:44.052890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:44.053425 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:44.058015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:44.073982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:44.075891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:44.090239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1270/2542] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:43 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:45.936511 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:45.937006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:45.937125 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:45.966187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] MFA Rules not processed for user `60d52bb66a004c7b876fafb221d6cb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:45.967319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:46.036573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1273/2543] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:45 2022] POST /identity/v3/auth/tokens => generated 3464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:46.048882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:46.051161 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:46.149849 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dd32f-4ca0-4a04-be74-8ca3e19a9a67 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:46.156448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:46.157184 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:46.157456 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:46.157761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:46.159528 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:46.219543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:46.221531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:46.231924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1271/2544] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:46 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:47.444923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:47.448217 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:47.467498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3afd2-0cf8-493d-8bc0-351fd481a3b0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:47.474972 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:47.475656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:47.476156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:47.476435 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:47.478512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:47.491998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:47.492186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:47.497904 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ecec-e3ef-41d8-95ef-7dc20753b895 service nova] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:47.511265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1274/2545] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:47 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:47.566529 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc4000-ce07-47f2-8efe-9589accfbf6c service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:47.571506 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:47.573014 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:47.573299 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:47.573578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] PATH_INFO: `/v3/users/d617a790490a439e9025e8b60cd5b8a7` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:47.574796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d617a790490a439e9025e8b60cd5b8a7)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:47.576738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:47.788334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd617a790490a439e9025e8b60cd5b8a7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:47.797472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd617a790490a439e9025e8b60cd5b8a7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:47.812543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd617a790490a439e9025e8b60cd5b8a7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:47.884002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd617a790490a439e9025e8b60cd5b8a7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:47.885356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd617a790490a439e9025e8b60cd5b8a7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:47.896016 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1272/2546] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:11:47 2022] DELETE /identity/v3/users/d617a790490a439e9025e8b60cd5b8a7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:11:47.898324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:47.898646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:47.898920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:47.922347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:47.923576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:47.990592 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1275/2547] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:11:47 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:11:48.001973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:48.003679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:48.098004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0913f-329f-4658-9a11-38d5512f8516 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:48.103613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:48.104617 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:48.104865 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:48.105831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:48.118058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:48.120384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c74b96-0d72-4b2c-8648-55f33a57fc6f service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:48.146902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1273/2548] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:11:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:11:48.892345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:48.894573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:48.911932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f083-ad85-4e98-bd59-81c97762e2d5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:48.918889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:48.922702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:48.924955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:48.924955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] PATH_INFO: `/v3/projects/027d34c5c8f44a64acbf7caba82fbac9` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:48.926432 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027d34c5c8f44a64acbf7caba82fbac9)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:48.928731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:49.118948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027d34c5c8f44a64acbf7caba82fbac9', 'request_id': 'req-153f0b04-a2f1-49e5-9288-8b44ceb04c23'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:49.126893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027d34c5c8f44a64acbf7caba82fbac9', 'request_id': 'req-153f0b04-a2f1-49e5-9288-8b44ceb04c23'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:49.277288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027d34c5c8f44a64acbf7caba82fbac9', 'request_id': 'req-153f0b04-a2f1-49e5-9288-8b44ceb04c23'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:49.288644 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] The token cache is being invalidate because project 027d34c5c8f44a64acbf7caba82fbac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:11:49.288937 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:49.289615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:11:49.292110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1276/2549] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:11:48 2022] DELETE /identity/v3/projects/027d34c5c8f44a64acbf7caba82fbac9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:11:53.429860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:53.430428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:53.430588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:53.449610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:11:53.450831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:53.512469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1274/2550] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:11:53 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:11:53.672534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:11:53.674850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:11:53.757543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f0b04-a2f1-49e5-9288-8b44ceb04c23 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:11:53.764486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:11:53.765088 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:11:53.765377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:11:53.765657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:11:53.775033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:11:53.776699 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:11:53.788165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1277/2551] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:12:02.953623 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:02.955090 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:03.023329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17579-9fa2-40a8-b360-63df2b06d126 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:03.028234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:03.029088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:03.029365 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:03.029636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] PATH_INFO: `/v3/users/14f6f890deb74eadab6b1ff4b6431036` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:03.030857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f6f890deb74eadab6b1ff4b6431036)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:03.033022 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:03.284853 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f6f890deb74eadab6b1ff4b6431036'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.291444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f6f890deb74eadab6b1ff4b6431036'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.303145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f6f890deb74eadab6b1ff4b6431036'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.368326 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f6f890deb74eadab6b1ff4b6431036'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.372061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f6f890deb74eadab6b1ff4b6431036'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.376111 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1275/2552] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:12:02 2022] DELETE /identity/v3/users/14f6f890deb74eadab6b1ff4b6431036 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:12:03.631815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:03.643282 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6122-f7b3-4c5d-9b56-e71e8b5ea78a service swift] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:03.701641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:03.702490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:03.702773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:03.703065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] PATH_INFO: `/v3/projects/2e991e35dc5b463fbf9f08db0e72cf46` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:03.704339 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e991e35dc5b463fbf9f08db0e72cf46)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:03.706384 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:03.815187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e991e35dc5b463fbf9f08db0e72cf46', 'request_id': 'req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.821744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e991e35dc5b463fbf9f08db0e72cf46', 'request_id': 'req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.928345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e991e35dc5b463fbf9f08db0e72cf46', 'request_id': 'req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.941399 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] The token cache is being invalidate because project 2e991e35dc5b463fbf9f08db0e72cf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:12:03.941766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.942325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:03.944034 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1278/2553] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:12:03 2022] DELETE /identity/v3/projects/2e991e35dc5b463fbf9f08db0e72cf46 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:03.949271 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:03.951363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:03.973778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf27a9-b17a-4ca6-8863-6c681151d80a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:04.036336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:04.037246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:04.037467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:04.037747 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] PATH_INFO: `/v3/users/97f15366c3c1404fa4755a3279b73ffd` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:04.039089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f15366c3c1404fa4755a3279b73ffd)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:04.041549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:04.251168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f15366c3c1404fa4755a3279b73ffd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.257795 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f15366c3c1404fa4755a3279b73ffd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.270148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f15366c3c1404fa4755a3279b73ffd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.357141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f15366c3c1404fa4755a3279b73ffd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.357790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-132c8e77-5ff7-44e7-9893-2a054cb38232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f15366c3c1404fa4755a3279b73ffd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.364286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1276/2554] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:12:03 2022] DELETE /identity/v3/users/97f15366c3c1404fa4755a3279b73ffd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:04.596575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:04.598114 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:04.613351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d2ef8-2c33-4d7f-b5f9-3b54768e3d5f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:04.671380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:04.672260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:04.672542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:04.672975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] PATH_INFO: `/v3/projects/7a8a79b146b04d03bc72a00b5d36f046` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:04.674156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8a79b146b04d03bc72a00b5d36f046)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:04.676074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:04.795627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8a79b146b04d03bc72a00b5d36f046', 'request_id': 'req-12106746-8959-4680-9f40-ff4fe1ca59dd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.803299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8a79b146b04d03bc72a00b5d36f046', 'request_id': 'req-12106746-8959-4680-9f40-ff4fe1ca59dd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.904852 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8a79b146b04d03bc72a00b5d36f046', 'request_id': 'req-12106746-8959-4680-9f40-ff4fe1ca59dd'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.915577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] The token cache is being invalidate because project 7a8a79b146b04d03bc72a00b5d36f046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:12:04.915997 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.916652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:12:04.918182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1279/2555] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:12:04 2022] DELETE /identity/v3/projects/7a8a79b146b04d03bc72a00b5d36f046 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:12:08.934439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53caaa-8c9f-427f-aa0c-cd3f122fe062 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:08.935010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53caaa-8c9f-427f-aa0c-cd3f122fe062 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:08.935010 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53caaa-8c9f-427f-aa0c-cd3f122fe062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:08.954208 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-9b53caaa-8c9f-427f-aa0c-cd3f122fe062 None None] MFA Rules not processed for user `4cdbf7d369e4437eae7a36529d6cd623`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:12:08.955881 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9b53caaa-8c9f-427f-aa0c-cd3f122fe062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:09.011361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1277/2556] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:12:09.320622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:09.322027 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:09.379124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12106746-8959-4680-9f40-ff4fe1ca59dd admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:09.382606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:09.383238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:09.383517 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:09.383814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:09.386316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:09.395815 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:09.397257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:09.405546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1280/2557] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:12:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:12:18.406340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:18.412099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:18.412099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:18.428890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:12:18.430114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:18.485498 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1278/2558] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:12:18 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:12:18.498225 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:18.500450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:18.568796 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406639a7-03cb-40fb-85a9-e90150e4ed55 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:18.574073 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:18.574641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:18.574924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:18.575201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:18.584374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:18.585983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f89ca-356b-4737-a774-3f2de7878526 service swift] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:18.594374 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1281/2559] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:12:28.286936 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:28.296928 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a722b-5245-4a1c-a675-6b6e033d1654 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:28.305571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:28.305571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:28.305571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:28.305571 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:28.306042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:28.370725 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:28.372381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:28.383089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1279/2560] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:12:39.132431 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358866d-e31a-4e09-a734-25ddebb4d109 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:39.132939 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358866d-e31a-4e09-a734-25ddebb4d109 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:39.133067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358866d-e31a-4e09-a734-25ddebb4d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:39.150578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-5358866d-e31a-4e09-a734-25ddebb4d109 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:12:39.151735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5358866d-e31a-4e09-a734-25ddebb4d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:39.159373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1282/2561] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:12:39 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:12:39.172013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:39.183882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3077ae-75b3-4042-abb0-f56c1564de81 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:39.189047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:39.189722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:39.190043 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:39.190311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:39.198239 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:39.199798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:39.207741 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1280/2562] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:12:55.466380 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd495f-da31-4899-84b0-8a871ed1fab2 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:55.466905 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd495f-da31-4899-84b0-8a871ed1fab2 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:55.467012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd495f-da31-4899-84b0-8a871ed1fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:55.486622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-17dd495f-da31-4899-84b0-8a871ed1fab2 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:12:55.491159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-17dd495f-da31-4899-84b0-8a871ed1fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:12:55.495776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1283/2563] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:12:55 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:12:55.518455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:12:55.530123 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4854-9920-4a13-985c-583afaa3a522 service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:12:55.535615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74058107-5048-4080-867f-5f46374ae25a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:12:55.536313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058107-5048-4080-867f-5f46374ae25a service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:12:55.536598 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058107-5048-4080-867f-5f46374ae25a service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:12:55.536878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74058107-5048-4080-867f-5f46374ae25a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:12:55.545128 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058107-5048-4080-867f-5f46374ae25a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:12:55.546719 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74058107-5048-4080-867f-5f46374ae25a service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:12:55.555585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1281/2564] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:03.434434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2daa-e00f-465d-8321-55f3c6254164 None None] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:03.434967 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2daa-e00f-465d-8321-55f3c6254164 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:03.435126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e2daa-e00f-465d-8321-55f3c6254164 None None] PATH_INFO: `/` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:03.437025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1284/2565] 10.222.0.79 () {54 vars in 921 bytes} [Fri Jan 28 02:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 02:13:03.443392 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:03.444995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:03.444995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:03.462366 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] MFA Rules not processed for user `87f23bd8046049038d1a5543cce545e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:03.463556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:03.470275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1282/2566] 10.222.0.79 () {58 vars in 1018 bytes} [Fri Jan 28 02:13:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:03.483837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2daa-e00f-465d-8321-55f3c6254164 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:03.495692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e2daa-e00f-465d-8321-55f3c6254164 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:03.499355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:03.500001 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:03.500292 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:03.500570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:03.507544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:03.509046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:03.516769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1285/2567] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:25.483763 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:25.485228 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:25.495780 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c2b4-4794-4ab2-b777-28f304b5ef74 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:25.499435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:25.500096 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:25.500379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:25.500651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:25.502307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:25.561489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:25.562900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:25.573418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1283/2568] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:29.106882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:29.108459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:29.131684 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d6b33-2224-4336-91f1-191f36b99af8 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:29.135070 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:29.136023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:29.136296 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:29.136573 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] PATH_INFO: `/v3/users/acab2a0c4a0e48909317791a3de85b53` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:29.137798 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acab2a0c4a0e48909317791a3de85b53)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:29.141848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:29.341255 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acab2a0c4a0e48909317791a3de85b53'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.342028 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acab2a0c4a0e48909317791a3de85b53'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.349816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acab2a0c4a0e48909317791a3de85b53'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.419574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acab2a0c4a0e48909317791a3de85b53'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.433008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4599c0c6-cb88-41f7-b74a-067b7bfe3a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acab2a0c4a0e48909317791a3de85b53'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.438763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1286/2569] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:29 2022] DELETE /identity/v3/users/acab2a0c4a0e48909317791a3de85b53 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:29.704799 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:29.717468 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a87e5-31ca-406a-adfe-0292b5d777ef service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:29.775369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:29.776265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:29.776553 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:29.776831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] PATH_INFO: `/v3/projects/0abe012ba65845329098e0e06c54b9c1` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:29.778072 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abe012ba65845329098e0e06c54b9c1)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:29.780073 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:29.892222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abe012ba65845329098e0e06c54b9c1', 'request_id': 'req-30472ea6-6b06-4565-b85b-37e4a9593c6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.897524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abe012ba65845329098e0e06c54b9c1', 'request_id': 'req-30472ea6-6b06-4565-b85b-37e4a9593c6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.979610 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abe012ba65845329098e0e06c54b9c1', 'request_id': 'req-30472ea6-6b06-4565-b85b-37e4a9593c6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.991546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] The token cache is being invalidate because project 0abe012ba65845329098e0e06c54b9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:29.991903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.994974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-30472ea6-6b06-4565-b85b-37e4a9593c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:29.994974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1284/2570] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:29 2022] DELETE /identity/v3/projects/0abe012ba65845329098e0e06c54b9c1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:30.000727 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.000999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.001278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.019097 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:30.020337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:30.078202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1287/2571] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:30.086640 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.086976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.087278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.106731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:30.107931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:30.115959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1285/2572] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:30.120154 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.129749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b734ab-2d42-4e9f-894d-1e93a0333106 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.134685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.135370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.135649 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.135920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.136667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:30.136971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.138614 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.151018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1288/2573] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:13:30.155422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.165298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685aabb-a02e-468e-871a-710eb1ee4c72 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.170301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.170940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.171220 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.171491 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.172362 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.174234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.300900 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1286/2574] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:30 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:30.305127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.315682 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b43c-6014-4300-80c7-aa0d49656280 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.373383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.374038 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.374318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.374590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.375269 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.377238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.482650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1289/2575] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:30 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:30.486897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.497210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53428c0-dd59-4a68-a106-f518d739117b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.501942 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.502587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.502872 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.503150 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.503863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.505469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.515669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1287/2576] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:30.519645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.530413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32173a-9a61-48f8-94e6-e0680005e4aa admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.535051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.535698 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.535999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.536293 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.537009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.539025 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e80e93-b63a-4867-954b-07c00df40a96 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.549068 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1290/2577] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:30.553297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.563351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ceafa-96d2-4bfe-859f-d24a964fa3f3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.568025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.571574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.571574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.571574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] PATH_INFO: `/v3/projects/1f53b8c6ef4b4ad0b9faad16f6ec1090/users/c42194cb660f4281846d35173443abaf/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.584989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f53b8c6ef4b4ad0b9faad16f6ec1090, user_id=c42194cb660f4281846d35173443abaf, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.587766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.688633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1288/2578] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:30 2022] PUT /identity/v3/projects/1f53b8c6ef4b4ad0b9faad16f6ec1090/users/c42194cb660f4281846d35173443abaf/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:30.700203 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.700495 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.700844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.728252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] MFA Rules not processed for user `c42194cb660f4281846d35173443abaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:30.729564 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:30.790898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1291/2579] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:30.804587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:30.806311 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:30.863002 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e73f-57a7-47e2-bd00-bf88d2dfced4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:30.867435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:30.868110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:30.868439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:30.868727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:30.877186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:30.878645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3dc4-ba9e-490a-9e51-211e8d11538e service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:30.888292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1289/2580] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3387 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:40.982595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:41.053051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a7bfd-e68e-4445-9d6c-cf1ed9509a27 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:41.060229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:41.061212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:41.061494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:41.061771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] PATH_INFO: `/v3/users/c42194cb660f4281846d35173443abaf` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:41.063316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42194cb660f4281846d35173443abaf)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:41.065218 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:41.267356 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42194cb660f4281846d35173443abaf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:41.268019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42194cb660f4281846d35173443abaf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:41.275567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42194cb660f4281846d35173443abaf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:41.368286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42194cb660f4281846d35173443abaf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:41.380646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42194cb660f4281846d35173443abaf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:41.386878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1292/2581] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:40 2022] DELETE /identity/v3/users/c42194cb660f4281846d35173443abaf => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:41.391856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:41.392481 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:41.392594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:41.410429 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:41.418487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:41.471061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1290/2582] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:41 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:41.482604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:41.484130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:41.543759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb4cfc-dd0d-4473-aa6e-cda134d064d4 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:41.547549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:41.548265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:41.548549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:41.548825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:41.558791 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:41.560262 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fe4dd-af90-4d7a-ae2e-9ec815058fe4 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:41.571144 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1293/2583] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:41 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:42.048766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.050343 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:42.063322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c05b-7dc1-4e07-afb0-21b85ee81b64 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.067933 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.068857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.069110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.069388 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] PATH_INFO: `/v3/projects/1f53b8c6ef4b4ad0b9faad16f6ec1090` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.071545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f53b8c6ef4b4ad0b9faad16f6ec1090)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.073573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.191722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f53b8c6ef4b4ad0b9faad16f6ec1090', 'request_id': 'req-7f2206a2-0533-4005-aa60-0d20a45e27ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.198268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f53b8c6ef4b4ad0b9faad16f6ec1090', 'request_id': 'req-7f2206a2-0533-4005-aa60-0d20a45e27ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.258440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f53b8c6ef4b4ad0b9faad16f6ec1090', 'request_id': 'req-7f2206a2-0533-4005-aa60-0d20a45e27ed'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.270422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] The token cache is being invalidate because project 1f53b8c6ef4b4ad0b9faad16f6ec1090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:42.270710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.271466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-7f2206a2-0533-4005-aa60-0d20a45e27ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:42.273699 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1291/2584] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:42 2022] DELETE /identity/v3/projects/1f53b8c6ef4b4ad0b9faad16f6ec1090 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:42.279720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.280278 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.280379 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.299048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:42.300312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:42.362659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1294/2585] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:42.374931 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.375222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.375511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.395061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:42.396380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:42.405509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1292/2586] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:42.410127 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.420945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bce7d-dbd5-4b97-920e-49b3a3c0edf0 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.426899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.427570 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.427851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.428170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.429412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:42.429412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.431265 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.443656 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1295/2587] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:42.449080 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.458584 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc75f-10a7-4dc9-84dd-e2151d640859 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.464478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.465157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.465439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.465712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.466545 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.468535 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.570743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1293/2588] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:42.575598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.586773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911c0fa-a509-418c-89b2-1507c7557e88 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.645412 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.645993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.646274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.646544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.647242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.649980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.764004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1296/2589] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/users => generated 282 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:42.768458 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.779357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d1322-7a6f-4336-bdcf-cc14d2dc6e1c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.784142 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.784822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.785107 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.785381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.786114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.787722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.800353 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1294/2590] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:42.805229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.815731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddccbd-5578-42ea-80e1-27e9a66a6e81 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.822180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.831861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.831861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.831861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.831861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.831861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b5b4-d16c-49b9-9e1c-8c9903d3ce85 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.836907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1297/2591] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:42.841244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:42.851932 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4679d4-40ce-4cdf-908b-e8c5a0bf2d64 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:42.856870 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:42.857827 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.858106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.858379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] PATH_INFO: `/v3/projects/22a4434e64ff475aa82461f2d4e1c711/users/014adfb3afa6411caa21fa0d19d1c99e/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.882005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a4434e64ff475aa82461f2d4e1c711, user_id=014adfb3afa6411caa21fa0d19d1c99e, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:42.885616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:42.951947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1295/2592] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:42 2022] PUT /identity/v3/projects/22a4434e64ff475aa82461f2d4e1c711/users/014adfb3afa6411caa21fa0d19d1c99e/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:42.962597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:42.962881 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:42.963158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:42.993572 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] MFA Rules not processed for user `014adfb3afa6411caa21fa0d19d1c99e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:42.994775 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:43.065637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1298/2593] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:43.070225 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.136349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384445e-958b-46a7-bce7-f5d66b13fc6a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.147259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.147947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.148274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.148549 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.149382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.151361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.259477 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1296/2594] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:43 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:43.260710 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.272148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43fe88-0610-4421-afaf-1a19bf9d2616 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.334102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.334834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.335050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.335325 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.336113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.338080 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.466187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1299/2595] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:43 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:43.470065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.481333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aa930-13b2-4f58-9f0d-23547af28dc0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.486346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.487244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.487613 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.487921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.488685 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.490586 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.502241 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1297/2596] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:43.506362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.516947 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532393f-d60e-43ad-9631-bf8c30838402 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.522254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.523933 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.524251 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.524575 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] PATH_INFO: `/v3/projects/f5964a7ec6274d13879174c30785911d/users/e8afead6b78c4f46ab520d2a77511085/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.542357 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5964a7ec6274d13879174c30785911d, user_id=e8afead6b78c4f46ab520d2a77511085, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.545136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.659849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1300/2597] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:43 2022] PUT /identity/v3/projects/f5964a7ec6274d13879174c30785911d/users/e8afead6b78c4f46ab520d2a77511085/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:43.664654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.674524 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112f9ec-9768-4566-bad2-358041e70fea admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.730290 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.730867 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.731154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.731430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.732191 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.733897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fecad-84b4-45d3-8994-76b6a5b7f6a4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.743878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1298/2598] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:43.748211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.758755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31737b9-2238-438d-a8ab-1597340b8748 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.763539 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.764451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.764736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.765013 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] PATH_INFO: `/v3/projects/f5964a7ec6274d13879174c30785911d/users/e8afead6b78c4f46ab520d2a77511085/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.766990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5964a7ec6274d13879174c30785911d, user_id=e8afead6b78c4f46ab520d2a77511085, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.769664 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.781271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1301/2599] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:43 2022] PUT /identity/v3/projects/f5964a7ec6274d13879174c30785911d/users/e8afead6b78c4f46ab520d2a77511085/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:43.793791 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.794081 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.794360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.822663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] MFA Rules not processed for user `e8afead6b78c4f46ab520d2a77511085`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:43.823878 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:43.893145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1299/2600] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:43 2022] POST /identity/v3/auth/tokens => generated 3452 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:43.904215 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:43.906138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:43.964810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045a987-eba2-4511-aeac-14749ebccbc9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:43.968781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:43.969424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:43.969840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:43.970122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:43.985951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:43.985951 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:43.992201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1302/2601] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:43 2022] GET /identity/v3/auth/tokens => generated 3452 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:44.254957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.266110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774cbc5-a85d-4c07-8fb8-3861ba891e63 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.269806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.270447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.270751 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.271028 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.330313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.331750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.341317 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1300/2602] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:44.641899 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:44.643336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:44.701006 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496aaf6-046a-4391-bee9-642bc0a11547 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:44.704678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:44.705321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:44.708033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:44.708033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:44.708033 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:44.770450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:44.772050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce953b-31d0-4963-9dae-a9e16b1bc9dc service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:44.782829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1303/2603] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:44 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:48.129125 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:48.152011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc207c1-7c6f-47e4-848f-837357176123 service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:48.158831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:48.159724 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.160120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.160796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] PATH_INFO: `/v3/users/014adfb3afa6411caa21fa0d19d1c99e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.162231 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014adfb3afa6411caa21fa0d19d1c99e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:48.165322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:48.407052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014adfb3afa6411caa21fa0d19d1c99e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.416089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014adfb3afa6411caa21fa0d19d1c99e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.440169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014adfb3afa6411caa21fa0d19d1c99e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.559757 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014adfb3afa6411caa21fa0d19d1c99e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.560727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014adfb3afa6411caa21fa0d19d1c99e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:48.569536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1301/2604] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:48 2022] DELETE /identity/v3/users/014adfb3afa6411caa21fa0d19d1c99e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:48.574605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.575773 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.576284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.604504 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:48.606163 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:48.679544 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1304/2605] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:48.690505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:48.692103 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:48.775761 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93cee1-bb54-426f-af9e-0d2847c27469 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:48.780256 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:48.781013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:48.781349 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:48.781679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:48.792596 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:48.794045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:48.804508 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1302/2606] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:48 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:49.065402 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.066975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.089424 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ae792-4367-413f-9a1e-e24730f0c5f6 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.096707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.099003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.099003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.099003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] PATH_INFO: `/v3/users/a6e7ef3a7fd145e5ab8726786ba318bb` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.101137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e7ef3a7fd145e5ab8726786ba318bb)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.104980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.404814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.406275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.422731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c31c30-c3c8-4e08-81bf-c960890091e7 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.426450 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.427300 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.427582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.427859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] PATH_INFO: `/v3/projects/22a4434e64ff475aa82461f2d4e1c711` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.429108 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a4434e64ff475aa82461f2d4e1c711)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.431089 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.436702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e7ef3a7fd145e5ab8726786ba318bb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.437382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e7ef3a7fd145e5ab8726786ba318bb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.444515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e7ef3a7fd145e5ab8726786ba318bb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.522499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e7ef3a7fd145e5ab8726786ba318bb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.536091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e7ef3a7fd145e5ab8726786ba318bb'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.543844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1305/2607] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/users/a6e7ef3a7fd145e5ab8726786ba318bb => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:49.592135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a4434e64ff475aa82461f2d4e1c711', 'request_id': 'req-363c127b-eb4b-49fd-9848-ea5c001d03be'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.598122 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a4434e64ff475aa82461f2d4e1c711', 'request_id': 'req-363c127b-eb4b-49fd-9848-ea5c001d03be'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.688154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a4434e64ff475aa82461f2d4e1c711', 'request_id': 'req-363c127b-eb4b-49fd-9848-ea5c001d03be'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.700325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] The token cache is being invalidate because project 22a4434e64ff475aa82461f2d4e1c711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:49.700674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.701416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:49.702960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1303/2608] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/projects/22a4434e64ff475aa82461f2d4e1c711 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:49.707340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.711237 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.791106 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c787cb1-22f1-4f77-9c96-73a426e1ea1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.821721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:49.830845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:49.858351 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.859885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.860273 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.860555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] PATH_INFO: `/v3/users/e8afead6b78c4f46ab520d2a77511085` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.861848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8afead6b78c4f46ab520d2a77511085)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.864681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:49.903775 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c127b-eb4b-49fd-9848-ea5c001d03be admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:49.909160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:49.910046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:49.918268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:49.918268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] PATH_INFO: `/v3/projects/6bdd27e926a84fa49844fbcca271bb19` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:49.918268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdd27e926a84fa49844fbcca271bb19)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:49.918268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.050408 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdd27e926a84fa49844fbcca271bb19', 'request_id': 'req-388e2784-5466-4c86-ac6a-09b97861dcc7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.050784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8afead6b78c4f46ab520d2a77511085'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.051446 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8afead6b78c4f46ab520d2a77511085'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.056889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdd27e926a84fa49844fbcca271bb19', 'request_id': 'req-388e2784-5466-4c86-ac6a-09b97861dcc7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.059145 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8afead6b78c4f46ab520d2a77511085'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.132731 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdd27e926a84fa49844fbcca271bb19', 'request_id': 'req-388e2784-5466-4c86-ac6a-09b97861dcc7'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.144748 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] The token cache is being invalidate because project 6bdd27e926a84fa49844fbcca271bb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:50.145042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.145721 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-388e2784-5466-4c86-ac6a-09b97861dcc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.147323 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1304/2609] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/projects/6bdd27e926a84fa49844fbcca271bb19 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:50.153439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161da19-ccce-4cfa-8fc1-c0b7652f0c1c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.153729 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161da19-ccce-4cfa-8fc1-c0b7652f0c1c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.154008 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161da19-ccce-4cfa-8fc1-c0b7652f0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.174094 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-4161da19-ccce-4cfa-8fc1-c0b7652f0c1c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:50.176116 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-4161da19-ccce-4cfa-8fc1-c0b7652f0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.239475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1305/2610] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:50.241288 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8afead6b78c4f46ab520d2a77511085'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.248222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.248514 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.248796 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.256533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8afead6b78c4f46ab520d2a77511085'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:50.263522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1306/2611] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:49 2022] DELETE /identity/v3/users/e8afead6b78c4f46ab520d2a77511085 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:50.269616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:50.271679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.356021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1306/2612] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:50.361406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.377430 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae8c2-cc07-483a-8d6f-1fcd896e8ad5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.382610 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.383281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.383569 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.383851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.384609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:50.384920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.386795 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.399582 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1307/2613] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:50.404140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.414499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8da4a-0c1b-40f3-9abc-4e847c6fb9c8 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.419443 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.420148 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.420432 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.420710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.421424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.423358 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.542164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1307/2614] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:50.546331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.556589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e3962-e5a9-48a5-9b30-47dbf0bc8bd9 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.619490 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.620284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.620668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.622286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.622286 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.624630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.724722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.727910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:50.739945 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c344ddd-ac41-4dc3-a35e-c3c9e1332d36 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.745786 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.747087 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.747615 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.747906 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] PATH_INFO: `/v3/projects/f5964a7ec6274d13879174c30785911d` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.749440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5964a7ec6274d13879174c30785911d)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.751446 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.758156 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1308/2615] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:50 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:50.762299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.773344 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87a6c-6732-4017-9271-f9e073fcd26f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.778830 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.779519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.779806 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.780131 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.780878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.782505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.793638 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1309/2616] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:50.810161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.821151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069965-5f15-497c-8b50-208d31e3ba1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.827489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.828206 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.828497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.828779 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.829507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.831141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:50.844395 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1310/2617] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:50.850347 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:50.860528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4749c-f1a1-42de-b89d-0185ac4bb121 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:50.865336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:50.866200 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:50.866487 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:50.866763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] PATH_INFO: `/v3/projects/a40337ceef6f436ca1f3a9669724c72b/users/a29e781f640b42e59ac2899d2846ff74/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:50.881164 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40337ceef6f436ca1f3a9669724c72b, user_id=a29e781f640b42e59ac2899d2846ff74, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:50.884246 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1c792-bbdf-4371-8d85-1685d8a5b5d7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.018878 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1311/2618] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:50 2022] PUT /identity/v3/projects/a40337ceef6f436ca1f3a9669724c72b/users/a29e781f640b42e59ac2899d2846ff74/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:51.026560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5964a7ec6274d13879174c30785911d', 'request_id': 'req-16a7c983-7fe3-4bb3-a888-cca248e32d9c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:51.029522 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.029818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.030098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.032482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5964a7ec6274d13879174c30785911d', 'request_id': 'req-16a7c983-7fe3-4bb3-a888-cca248e32d9c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:51.057586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] MFA Rules not processed for user `a29e781f640b42e59ac2899d2846ff74`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:51.058822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.134513 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5964a7ec6274d13879174c30785911d', 'request_id': 'req-16a7c983-7fe3-4bb3-a888-cca248e32d9c'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:51.136377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1312/2619] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3407 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:51.140665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.148052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] The token cache is being invalidate because project f5964a7ec6274d13879174c30785911d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:51.148618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:51.149206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-16a7c983-7fe3-4bb3-a888-cca248e32d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:51.150960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1308/2620] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:50 2022] DELETE /identity/v3/projects/f5964a7ec6274d13879174c30785911d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:51.159701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8770d7-93de-4a9b-83b7-5d0d6a0b3c53 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.160042 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8770d7-93de-4a9b-83b7-5d0d6a0b3c53 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.160322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8770d7-93de-4a9b-83b7-5d0d6a0b3c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.178344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-ee8770d7-93de-4a9b-83b7-5d0d6a0b3c53 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:51.180088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-ee8770d7-93de-4a9b-83b7-5d0d6a0b3c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.213591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972245-fa8a-4750-90fb-4e0b68ec0885 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.218252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.218901 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.219180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.219450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.220166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.222310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.248677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1309/2621] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:51.256671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.256987 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.257912 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.276877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:51.278078 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.286478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1310/2622] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:51.291359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.300534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6428a66-fcdf-46f7-99c7-7fbe283f96fe None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.310482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.311285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.311713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.312135 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.313053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:51.313489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.315149 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.324567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1313/2623] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:51.328539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1311/2624] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:13:51.328894 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.331039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.332692 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.345494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674c672-14b1-43e3-914a-ef341aaa1b5c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.403051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2f2ef-db39-4654-a5b8-aeb6e4585198 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.407810 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.408505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.408783 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.409056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.409447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.409734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.410098 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.410384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.410662 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.411359 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.411717 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.413905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.511175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1314/2625] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:51.516387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.526764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8802ef6-79e2-4d3e-a076-9ea4cd31162f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.534067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.534736 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.535015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.535295 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.536039 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.537630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.549224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1315/2626] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:51.553292 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1312/2627] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:51.553907 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.561390 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.569406 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86925b63-b453-4538-89f8-405f357ff749 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.629130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.630340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.630621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.630898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] PATH_INFO: `/v3/projects/880b12172102453e9191a1388677b476/users/1163569a2e554c26a471fffbafcf13c8/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.632478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7f834-23fb-46a4-8f1b-0a02db75b973 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.637723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.638389 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.638734 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.639011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.639716 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.641669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.645692 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] RBAC: Authorizing `identity:create_grant(project_id=880b12172102453e9191a1388677b476, user_id=1163569a2e554c26a471fffbafcf13c8, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.648876 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.739667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1316/2628] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:51 2022] PUT /identity/v3/projects/880b12172102453e9191a1388677b476/users/1163569a2e554c26a471fffbafcf13c8/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:51.743913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.751887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1313/2629] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:51.756200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.766230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb6d1-0c65-4cdb-9959-e23e071fe63e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.809096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55af-f8b0-4eee-bb24-80082f17257d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.814261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.814919 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.815202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.815472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.816210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.817802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.832003 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1317/2630] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:51.832274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.832274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.832274 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.832566 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.833089 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.833674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.837254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.843925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0e5a-f502-41f3-8fd7-ea9d37879248 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.849415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.850306 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.850436 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1314/2631] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:51.850587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.851496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] PATH_INFO: `/v3/projects/880b12172102453e9191a1388677b476/users/1163569a2e554c26a471fffbafcf13c8/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.853647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880b12172102453e9191a1388677b476, user_id=1163569a2e554c26a471fffbafcf13c8, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.855531 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.856494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a14d-0e2e-4f07-aae7-0b50c7d350a1 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.866822 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13702d-6ad9-402f-be83-0bb3cbbe0b4a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.876595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1318/2632] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:51 2022] PUT /identity/v3/projects/880b12172102453e9191a1388677b476/users/1163569a2e554c26a471fffbafcf13c8/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:51.879109 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.879483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.879920 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.909194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] MFA Rules not processed for user `1163569a2e554c26a471fffbafcf13c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:51.910404 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:51.930132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.930798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.931083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.931361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.932157 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.933806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.947639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1315/2633] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:51.950146 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.958209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1e38b-b568-4b9b-bd77-a1c58f257d42 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:51.964082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:51.964965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:51.965250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:51.965686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] PATH_INFO: `/v3/projects/dd86781dedd349f589cf63d394a7711f/users/4cccf6a72d9846d49635726db8570ed9/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:51.980540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1319/2634] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3472 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:51.981808 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd86781dedd349f589cf63d394a7711f, user_id=4cccf6a72d9846d49635726db8570ed9, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:51.984654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844819d-7491-4933-92f4-43490fca50e6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:51.990898 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:51.992261 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:52.051175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6377b-e76e-400a-98d4-e23d0a5e553c None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:52.054949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:52.055591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.055871 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.056182 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.059860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1316/2635] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:51 2022] PUT /identity/v3/projects/dd86781dedd349f589cf63d394a7711f/users/4cccf6a72d9846d49635726db8570ed9/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:52.070742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:52.070742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:52.071034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.071453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.071730 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.078598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1320/2636] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:51 2022] GET /identity/v3/auth/tokens => generated 3472 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:13:52.101249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] MFA Rules not processed for user `4cccf6a72d9846d49635726db8570ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:52.102568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:52.108224 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:52.118846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109aaa4-f7ac-4c4d-8eb6-5e19e4e7cf7f service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:52.175439 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1317/2637] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:52.179793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:52.180716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.181026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.181299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] PATH_INFO: `/v3/users/a29e781f640b42e59ac2899d2846ff74` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.182528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29e781f640b42e59ac2899d2846ff74)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:52.184700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:52.186342 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:52.187758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:52.245555 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3fbe4-5689-4862-a12c-ac9af160620c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:52.249204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:52.249861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.250152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.250426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.260511 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:52.261985 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975effe-9461-4d66-ad5f-87b196a612cb service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:52.271301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1318/2638] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3395 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:13:52.432327 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29e781f640b42e59ac2899d2846ff74'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:52.432983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29e781f640b42e59ac2899d2846ff74'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:52.439577 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29e781f640b42e59ac2899d2846ff74'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:52.549648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29e781f640b42e59ac2899d2846ff74'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:52.562223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29e781f640b42e59ac2899d2846ff74'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:52.569000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1321/2639] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:52 2022] DELETE /identity/v3/users/a29e781f640b42e59ac2899d2846ff74 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:52.574156 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.574620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.574732 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.593066 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:52.599435 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:52.653331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1319/2640] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:52.663538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:52.664994 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:52.723111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48908-7513-4b77-90ce-28541f0c28d3 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:52.727718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:52.728449 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:52.728733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:52.729214 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:52.738971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:52.740469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:52.750807 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1322/2641] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:53.180038 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:53.194244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:53.196994 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277276ef-22cf-403c-99ba-e52f6398a3a6 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:53.202510 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:53.203409 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:53.203636 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:53.203951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] PATH_INFO: `/v3/projects/a40337ceef6f436ca1f3a9669724c72b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:53.205250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40337ceef6f436ca1f3a9669724c72b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:53.207154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:53.362930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40337ceef6f436ca1f3a9669724c72b', 'request_id': 'req-e08d3938-c118-4118-bd9c-6e8b7b389ea4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.368307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40337ceef6f436ca1f3a9669724c72b', 'request_id': 'req-e08d3938-c118-4118-bd9c-6e8b7b389ea4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.458686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40337ceef6f436ca1f3a9669724c72b', 'request_id': 'req-e08d3938-c118-4118-bd9c-6e8b7b389ea4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.470904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] The token cache is being invalidate because project a40337ceef6f436ca1f3a9669724c72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:53.471190 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.478568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.478568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1320/2642] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:53 2022] DELETE /identity/v3/projects/a40337ceef6f436ca1f3a9669724c72b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:53.478938 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:53.488383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658345e-9339-4d26-9d62-b397640dffe9 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:53.544764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:53.545630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:53.545942 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:53.546219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] PATH_INFO: `/v3/users/1163569a2e554c26a471fffbafcf13c8` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:53.547403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1163569a2e554c26a471fffbafcf13c8)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:53.549410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:53.725369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1163569a2e554c26a471fffbafcf13c8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.726093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1163569a2e554c26a471fffbafcf13c8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.732651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1163569a2e554c26a471fffbafcf13c8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.818190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1163569a2e554c26a471fffbafcf13c8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.830738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ca1332aa-9ec6-43c6-9607-6d96d085c4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1163569a2e554c26a471fffbafcf13c8'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:53.837104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1323/2643] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:53 2022] DELETE /identity/v3/users/1163569a2e554c26a471fffbafcf13c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:54.260314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.262527 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:54.275438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d3938-c118-4118-bd9c-6e8b7b389ea4 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.332807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.333656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.333988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.334310 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] PATH_INFO: `/v3/projects/880b12172102453e9191a1388677b476` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.336499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880b12172102453e9191a1388677b476)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.338426 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:54.492047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880b12172102453e9191a1388677b476', 'request_id': 'req-8f533238-28cd-4f1c-962d-cbbbab7878f4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.497238 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880b12172102453e9191a1388677b476', 'request_id': 'req-8f533238-28cd-4f1c-962d-cbbbab7878f4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.579140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880b12172102453e9191a1388677b476', 'request_id': 'req-8f533238-28cd-4f1c-962d-cbbbab7878f4'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.592048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] The token cache is being invalidate because project 880b12172102453e9191a1388677b476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:54.592048 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.593452 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-8f533238-28cd-4f1c-962d-cbbbab7878f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:54.594396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1321/2644] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:54 2022] DELETE /identity/v3/projects/880b12172102453e9191a1388677b476 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:54.600367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.601043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.601194 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.619927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:54.627661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:54.682864 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1324/2645] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:54.691562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.691989 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.692374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.717560 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:54.718774 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:54.728052 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1322/2646] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:54 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:54.732601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.742267 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c314dd-17fa-4faa-9fe8-41ba594a4343 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.747499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.747925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.748230 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.748507 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.749281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:54.749589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.751184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:54.763043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1325/2647] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:54.767361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.777282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ddaf4-a56c-4d4c-8e75-deb817b4a34c None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.782059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.782697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.782977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.783249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.783937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.785831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:54.883001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1323/2648] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:54 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:54.887313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:54.897365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1150bb-7d5f-485f-85ef-3919aa617a94 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:54.957502 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:54.958198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:54.958485 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:54.958766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:54.959561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:54.962093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.077555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1326/2649] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:54 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:55.081633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.092781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05536f87-3f77-45df-92a8-f29cca97a89b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.098713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.099378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.100474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.101162 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.102374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.103999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.114924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1324/2650] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:55.126320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.137950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f462-6389-4dbe-97a6-49ef68ee59ad admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.142679 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.143747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.143747 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.144527 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.144734 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.146360 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a917407-dda7-4cbb-90ff-8874822b1f5b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.157472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1327/2651] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:55.161785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.171842 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3c47-eb69-4f90-93e7-71a30a1b125b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.176397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.177471 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.177621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.177891 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] PATH_INFO: `/v3/projects/3370854f62c54f779200a21d8f4b9428/users/9fa9b5d62ab94f9d916ba81788d2e0ee/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.192567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3370854f62c54f779200a21d8f4b9428, user_id=9fa9b5d62ab94f9d916ba81788d2e0ee, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.196040 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.299280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1325/2652] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:55 2022] PUT /identity/v3/projects/3370854f62c54f779200a21d8f4b9428/users/9fa9b5d62ab94f9d916ba81788d2e0ee/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:13:55.311371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.311657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.311934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.341944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] MFA Rules not processed for user `9fa9b5d62ab94f9d916ba81788d2e0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:55.343132 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:55.409301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1328/2653] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:55.414266 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.483462 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55f36b-1ccb-4bc7-bab8-5cdac7fa879a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.488820 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.489622 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.490021 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.490306 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.491012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.493814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.574316 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1326/2654] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:55.578362 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.589560 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c5b5-2c22-4d20-a39c-c1434443f29e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.645719 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.646427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.646693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.646965 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.648159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.650147 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.705408 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1329/2655] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:55 2022] POST /identity/v3/users => generated 302 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:55.709137 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.719756 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d0c9-6b8f-4a29-a16f-70a7f6e7190f admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.725084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.725834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.726472 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.726955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.727832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.729855 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.740608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1327/2656] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:55.745519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.755877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2c76-a5a4-42ab-ac1b-43494769fe34 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.761428 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.762321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.762745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.762867 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] PATH_INFO: `/v3/projects/6e5155f501344d8ba00b60cfefd71739/users/a92b857ed02e4433845df2898c2ed78e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.779694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5155f501344d8ba00b60cfefd71739, user_id=a92b857ed02e4433845df2898c2ed78e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.782398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.883019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1330/2657] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:55 2022] PUT /identity/v3/projects/6e5155f501344d8ba00b60cfefd71739/users/a92b857ed02e4433845df2898c2ed78e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:55.887054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.897313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a2ce5-b050-421e-bad3-db1b50b140fb admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.953350 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.954009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.954296 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.954572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.955351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.957297 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b071d6-a4e9-407a-bc9f-1d1e7c913479 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:55.967578 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1328/2658] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:13:55.971788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:55.983086 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056751a0-abe2-42e2-af22-cc8d9db190f0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:55.988249 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:55.990426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:55.990426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:55.990426 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] PATH_INFO: `/v3/projects/6e5155f501344d8ba00b60cfefd71739/users/a92b857ed02e4433845df2898c2ed78e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:55.992602 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5155f501344d8ba00b60cfefd71739, user_id=a92b857ed02e4433845df2898c2ed78e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:55.995287 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.005725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1331/2659] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:55 2022] PUT /identity/v3/projects/6e5155f501344d8ba00b60cfefd71739/users/a92b857ed02e4433845df2898c2ed78e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:56.016410 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.016697 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.016976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.050325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] MFA Rules not processed for user `a92b857ed02e4433845df2898c2ed78e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:56.051523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.117952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1329/2660] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3478 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:56.127844 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.129543 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.186689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a081bb-ee8d-4202-b1d7-3c918116319d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.190398 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.191040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.191318 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.191590 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.200944 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.202345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.212059 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1332/2661] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3478 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:56.256346 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.258053 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.269922 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c713b-c77a-4ef2-83e5-de5c370dc85e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.274211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.274841 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.275163 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.275438 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.330728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.332313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4175-1468-4b2d-996b-e5278d7f57c7 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.342250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1330/2662] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:56.415245 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.416720 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.484274 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295ee9a-4c57-4909-9e18-060f14fb8737 service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.489199 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.490123 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.490407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.490685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] PATH_INFO: `/v3/users/4cccf6a72d9846d49635726db8570ed9` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.492137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cccf6a72d9846d49635726db8570ed9)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.494042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:56.690892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cccf6a72d9846d49635726db8570ed9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:56.691598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cccf6a72d9846d49635726db8570ed9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:56.699312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cccf6a72d9846d49635726db8570ed9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:56.790492 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cccf6a72d9846d49635726db8570ed9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:56.804135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cccf6a72d9846d49635726db8570ed9'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:56.816196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1333/2663] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:13:56 2022] DELETE /identity/v3/users/4cccf6a72d9846d49635726db8570ed9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:56.818327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.818627 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.818916 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.838321 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:56.840818 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.903000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1331/2664] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:56 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:56.914879 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:56.917257 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:56.978078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8762f-b134-478b-a805-e2400ffa7c84 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:56.982444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:56.983096 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:56.983376 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:56.983660 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:56.994519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:56.995961 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4dc91-9a0e-490f-a7a3-9c88af7004ee service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:57.006071 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1334/2665] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:13:57.462259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.463711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.476635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43cb00-f508-47bc-9781-99237d2e8295 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.481607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.482639 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.482927 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.483199 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] PATH_INFO: `/v3/projects/dd86781dedd349f589cf63d394a7711f` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.484595 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd86781dedd349f589cf63d394a7711f)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.486587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:57.583075 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd86781dedd349f589cf63d394a7711f', 'request_id': 'req-45d3637a-c579-422c-a372-431f20550aae'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.589285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd86781dedd349f589cf63d394a7711f', 'request_id': 'req-45d3637a-c579-422c-a372-431f20550aae'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.653512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd86781dedd349f589cf63d394a7711f', 'request_id': 'req-45d3637a-c579-422c-a372-431f20550aae'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.665275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] The token cache is being invalidate because project dd86781dedd349f589cf63d394a7711f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:13:57.665567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.666210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-45d3637a-c579-422c-a372-431f20550aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:13:57.667750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1332/2666] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:13:57 2022] DELETE /identity/v3/projects/dd86781dedd349f589cf63d394a7711f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:57.673657 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.673988 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.674294 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.693174 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:57.695442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.762110 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1335/2667] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:57.771469 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.771758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.772110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.792329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:57.793567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:57.802027 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1333/2668] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:57.806966 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.817275 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6000d0-3005-4e99-ba71-5f87356c8c88 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.824098 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.824731 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.825091 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.825271 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.826004 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:13:57.826335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.827990 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:57.841489 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1336/2669] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:13:57.856318 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:57.867061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2512ae-5c3b-439c-ac84-9695a189f4c5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:57.872315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:57.872977 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:57.873264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:57.873543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:57.875616 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:57.876285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.003924 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1334/2670] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:57 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:58.005479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.016971 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97547a-21f6-481d-b714-751630fd8fd5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.087480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.088207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.088493 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.088780 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.089496 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.091498 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.228845 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1337/2671] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:58.236207 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.243305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5a0bf-2140-4f22-8f01-9112c877b979 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.247877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.248572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.248852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.249119 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.249837 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.251418 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.261955 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1335/2672] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:58.266561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.277136 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29e358-25a0-4b0c-9914-8a598016b057 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.282349 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437b4f2-bbc0-4d61-bd86-b137b645dca4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.305601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1338/2673] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:58.312206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.329554 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f269213-dc97-4d10-a5ef-a9c9c72b98d3 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.335182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.338367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.338367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.338367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] PATH_INFO: `/v3/projects/d57dc0c1022b4596bb0d28aad886b9be/users/20b572ae03d94340bcc9c2601a135d01/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.353547 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57dc0c1022b4596bb0d28aad886b9be, user_id=20b572ae03d94340bcc9c2601a135d01, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.356331 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.437158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1336/2674] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:58 2022] PUT /identity/v3/projects/d57dc0c1022b4596bb0d28aad886b9be/users/20b572ae03d94340bcc9c2601a135d01/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:58.447960 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.448372 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.448724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.477319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] MFA Rules not processed for user `20b572ae03d94340bcc9c2601a135d01`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:58.478617 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:58.551258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1339/2675] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/auth/tokens => generated 3405 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:13:58.556846 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.622209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe811805-44d1-420f-9704-37b42ac473a6 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.626998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.630678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.630678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.630678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.630678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.631132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:58.791607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1337/2676] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:58.794240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:58.806090 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c12dd8-04e8-42a6-8e85-c5d6e9b5e9e5 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:58.891769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:58.892540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:58.892826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:58.893112 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:58.893804 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:58.895765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.010633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1340/2677] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:58 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:13:59.015482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.026944 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566c23a-ad79-46b8-a3ac-311f50286754 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.032212 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.032897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.033229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.033541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.034286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.036261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.048354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1338/2678] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:59.052319 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.063407 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd775b-9328-4097-bd9d-4604fb4226d6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.071752 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.072846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.073350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.073825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.075113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.076811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfea33-1a05-4943-9ece-24775302d0c4 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.089641 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1341/2679] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:59.093836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.105419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983dcd-abba-4795-8f33-d0853b1a310a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.110698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.111645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.111926 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.112234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] PATH_INFO: `/v3/projects/d4afd8c237a44d31a643bb098a787cdc/users/86dbf06371be49708268f19b60ecafda/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.133493 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4afd8c237a44d31a643bb098a787cdc, user_id=86dbf06371be49708268f19b60ecafda, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.136722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.277217 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1339/2680] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:59 2022] PUT /identity/v3/projects/d4afd8c237a44d31a643bb098a787cdc/users/86dbf06371be49708268f19b60ecafda/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:13:59.294749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.295191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.295596 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.327713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] MFA Rules not processed for user `86dbf06371be49708268f19b60ecafda`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:13:59.328906 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:13:59.409303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1342/2681] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:13:59 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:13:59.414781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.480505 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57873-ee76-4042-99d8-78e496a41265 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.487378 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.488169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.488428 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.488707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.489411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.491592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.601744 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1340/2682] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:13:59 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:59.605528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.622323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954a447-acee-4c18-a8f1-1948a7f97678 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.702635 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.703455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.703651 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.703889 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.704681 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.706667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.812069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1343/2683] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:13:59 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:13:59.814034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.825015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e839d-24e5-4744-8097-724af72d1baa admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.829961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.830661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.830946 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.831223 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.832015 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.834686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:13:59.845193 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1341/2684] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:13:59.849711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:13:59.861963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a326844-a665-4d4b-8a33-d31183862123 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:13:59.868103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:13:59.868999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:13:59.869345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:13:59.869625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] PATH_INFO: `/v3/projects/263ea453139b42c4b781ac63a6e79c40/users/213fe995f7724f69b2cc8c5794eda6b0/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:13:59.886049 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263ea453139b42c4b781ac63a6e79c40, user_id=213fe995f7724f69b2cc8c5794eda6b0, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:13:59.889180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:00.002622 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1344/2685] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:13:59 2022] PUT /identity/v3/projects/263ea453139b42c4b781ac63a6e79c40/users/213fe995f7724f69b2cc8c5794eda6b0/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:00.006687 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:00.017282 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b076211-1f2b-4552-8a97-3610e2b77742 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:00.076663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:00.077325 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:00.077607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:00.077882 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:00.078604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:00.080216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab74379-3240-490e-ab5d-a018b38a56c9 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:00.091026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1342/2686] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:00.095451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:00.107329 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f52e6-4cae-4d26-9ed7-c37be17f8103 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:00.112104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:00.112978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:00.113260 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:00.113536 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] PATH_INFO: `/v3/projects/263ea453139b42c4b781ac63a6e79c40/users/213fe995f7724f69b2cc8c5794eda6b0/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:00.115499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263ea453139b42c4b781ac63a6e79c40, user_id=213fe995f7724f69b2cc8c5794eda6b0, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:00.118228 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:00.129609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1345/2687] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:00 2022] PUT /identity/v3/projects/263ea453139b42c4b781ac63a6e79c40/users/213fe995f7724f69b2cc8c5794eda6b0/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:00.143229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:00.144105 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:00.144665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:00.178588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] MFA Rules not processed for user `213fe995f7724f69b2cc8c5794eda6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:00.179814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:00.247759 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1343/2688] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:00 2022] POST /identity/v3/auth/tokens => generated 3470 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:00.258594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:00.260368 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:00.322668 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bfadd-5c5d-48a6-928d-a1e63abb11e5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:00.326909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:00.327606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:00.327893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:00.328212 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:00.385761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:00.387155 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad668dcb-c737-448f-a096-6f77efbae685 service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:00.396281 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1346/2689] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:00 2022] GET /identity/v3/auth/tokens => generated 3405 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:01.271164 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:01.272727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:01.337427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc041-bcb9-41bb-9912-5223d64437e5 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:01.342118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:01.342976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:01.343260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:01.343538 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] PATH_INFO: `/v3/users/9fa9b5d62ab94f9d916ba81788d2e0ee` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:01.344749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa9b5d62ab94f9d916ba81788d2e0ee)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:01.346646 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:01.563298 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa9b5d62ab94f9d916ba81788d2e0ee'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:01.569992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa9b5d62ab94f9d916ba81788d2e0ee'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:01.581393 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa9b5d62ab94f9d916ba81788d2e0ee'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:01.675813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa9b5d62ab94f9d916ba81788d2e0ee'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:01.676494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa9b5d62ab94f9d916ba81788d2e0ee'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:01.682911 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1344/2690] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:01 2022] DELETE /identity/v3/users/9fa9b5d62ab94f9d916ba81788d2e0ee => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:01.687784 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:01.688326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:01.688440 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:01.705655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:01.706848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:01.764670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1347/2691] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:01 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:01.775026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:01.776455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:01.831714 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b57da4-2c22-4084-a446-1939baf61b4a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:01.836601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:01.837254 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:01.837532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:01.837807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:01.847334 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:01.848784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:01.858373 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1345/2692] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:01 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:02.240831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.242909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.268975 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39d230-143e-4db6-a621-0759dd33b712 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.274378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.275367 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.275851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.276264 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] PATH_INFO: `/v3/projects/3370854f62c54f779200a21d8f4b9428` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.277494 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3370854f62c54f779200a21d8f4b9428)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.279584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.318664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.320720 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.375001 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356cbc7-ef38-452a-8d11-596a5cf6ab36 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.378782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.379419 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.379698 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.379997 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.382537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:02.439904 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.441367 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.442593 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3370854f62c54f779200a21d8f4b9428', 'request_id': 'req-7ed0a796-26f1-4166-b3ec-3bfbc591c280'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.449744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3370854f62c54f779200a21d8f4b9428', 'request_id': 'req-7ed0a796-26f1-4166-b3ec-3bfbc591c280'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.451243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1346/2693] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:02 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:02.533190 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3370854f62c54f779200a21d8f4b9428', 'request_id': 'req-7ed0a796-26f1-4166-b3ec-3bfbc591c280'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.544661 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] The token cache is being invalidate because project 3370854f62c54f779200a21d8f4b9428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:02.544945 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.545567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.547095 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1348/2694] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:02 2022] DELETE /identity/v3/projects/3370854f62c54f779200a21d8f4b9428 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:02.551088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:02.562546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbae32e-313a-49cb-a1e9-671257f203ac service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:02.618621 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:02.619495 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:02.619772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:02.620076 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] PATH_INFO: `/v3/users/a92b857ed02e4433845df2898c2ed78e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:02.621275 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92b857ed02e4433845df2898c2ed78e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:02.623678 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:02.811357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92b857ed02e4433845df2898c2ed78e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.819572 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92b857ed02e4433845df2898c2ed78e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.831195 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92b857ed02e4433845df2898c2ed78e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.899444 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92b857ed02e4433845df2898c2ed78e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.900110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-b9ef1efd-5ce1-4a03-af0b-4a9a50c7378a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92b857ed02e4433845df2898c2ed78e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:02.906406 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1347/2695] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:02 2022] DELETE /identity/v3/users/a92b857ed02e4433845df2898c2ed78e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:03.306931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.308207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.322659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0a796-26f1-4166-b3ec-3bfbc591c280 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:03.379552 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:03.380448 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.380737 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.381015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] PATH_INFO: `/v3/projects/6e5155f501344d8ba00b60cfefd71739` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.383137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5155f501344d8ba00b60cfefd71739)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:03.385202 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:03.524312 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5155f501344d8ba00b60cfefd71739', 'request_id': 'req-bda5983a-a375-42fd-9b46-4659bb3509b5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:03.530429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5155f501344d8ba00b60cfefd71739', 'request_id': 'req-bda5983a-a375-42fd-9b46-4659bb3509b5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:03.625063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5155f501344d8ba00b60cfefd71739', 'request_id': 'req-bda5983a-a375-42fd-9b46-4659bb3509b5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:03.636702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] The token cache is being invalidate because project 6e5155f501344d8ba00b60cfefd71739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:03.637008 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:03.639180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-bda5983a-a375-42fd-9b46-4659bb3509b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:03.639180 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1349/2696] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:03 2022] DELETE /identity/v3/projects/6e5155f501344d8ba00b60cfefd71739 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:03.644871 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.645354 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.645449 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.664532 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:03.666604 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.729654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1348/2697] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:03.738555 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.738885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.739204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.759834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:03.761078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.769111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1350/2698] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:03 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:03.773305 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.782856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5cef-688e-4ca9-b668-4684eb939bf7 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:03.787899 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:03.788812 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.789140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.789455 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.790144 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:14:03.790484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:03.792167 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:03.805248 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1349/2699] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:14:03.810152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.824056 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dafafe-d4e5-44ec-91df-b9ff2f110873 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:03.828829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:03.829479 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:03.829763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:03.830042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:03.830739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:03.832704 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:03.918682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.921315 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:03.926326 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1351/2700] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:03 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:03.941258 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:03.997536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9bd0-20be-439b-b40c-75e28f970a80 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.027085 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5f78-81fe-4f7f-bc8e-863bb53a14e8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.032391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.033074 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.033350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.033633 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.034331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.036310 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.056550 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.057201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.057516 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.057792 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.059575 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:04.126863 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.128308 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.138268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1350/2701] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:03 2022] GET /identity/v3/auth/tokens => generated 3470 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:04.159911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1352/2702] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:03 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:14:04.163696 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.173473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674fdc3-7d6c-47ba-b095-2e9f1ffbac9f service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.178260 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.179847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.180247 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.180525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.181250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.182836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.192953 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1351/2703] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:04.211818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.221927 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334abcf-0431-436a-8213-50a72cfbb722 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.227470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.228159 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.228443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.228776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.229436 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.231018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361f23-9455-421c-82f5-af3103834acf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.241834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1353/2704] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:04.246313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.256285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea412e5-b079-4a89-bf59-0680c4ba5cc7 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.261064 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.261941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.262219 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.262489 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] PATH_INFO: `/v3/projects/71d421fd2f1d49e2b4d304361deb4d6b/users/e3d6728eac9b4b99abd7e055282c3e6f/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.278682 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d421fd2f1d49e2b4d304361deb4d6b, user_id=e3d6728eac9b4b99abd7e055282c3e6f, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.281374 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.374431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1352/2705] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:04 2022] PUT /identity/v3/projects/71d421fd2f1d49e2b4d304361deb4d6b/users/e3d6728eac9b4b99abd7e055282c3e6f/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:04.384954 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.385433 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.385557 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.412808 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] MFA Rules not processed for user `e3d6728eac9b4b99abd7e055282c3e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:04.414529 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:04.487345 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1354/2706] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:04 2022] POST /identity/v3/auth/tokens => generated 3419 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:04.492633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.552921 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebd1ef-6114-4eaa-9a74-e4de936838df admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.558546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.559261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.559539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.559807 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.560581 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.562499 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.643222 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1353/2707] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:04 2022] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:04.647792 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.662611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48fd9-6d13-4be0-aefe-12693ff0b989 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.730361 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.731092 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.731480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.731763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.732547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.734503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.830574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1355/2708] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:04 2022] POST /identity/v3/users => generated 307 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:04.834661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.845474 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957f3f4-d0e8-414b-b25a-58bd8d205fa1 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.850902 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.856968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.856968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.856968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.856968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.856968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.866941 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1354/2709] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:04.871313 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.881970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3721-1b35-4176-9f16-2c0c51c059d6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:04.886915 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:04.887820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:04.888152 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:04.888510 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] PATH_INFO: `/v3/projects/ea5ec190e0204febae78d68c52038741/users/38d6a8be14f048ff824572bcc34de94e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:04.903595 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5ec190e0204febae78d68c52038741, user_id=38d6a8be14f048ff824572bcc34de94e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:04.906646 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:04.969365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1356/2710] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:04 2022] PUT /identity/v3/projects/ea5ec190e0204febae78d68c52038741/users/38d6a8be14f048ff824572bcc34de94e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:04.973767 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:04.984793 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5696b3-6a7e-495d-a955-a3376fd06f72 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:05.042172 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:05.046186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.046186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.046186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.046186 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:05.046986 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cc58e-3153-494d-82d1-4bc2958d5313 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:05.058079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1355/2711] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:05.062655 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:05.073553 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701185e2-4731-4582-a245-c7e080d3c3ca admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:05.079048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:05.079948 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.080266 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.080542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] PATH_INFO: `/v3/projects/ea5ec190e0204febae78d68c52038741/users/38d6a8be14f048ff824572bcc34de94e/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.082528 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5ec190e0204febae78d68c52038741, user_id=38d6a8be14f048ff824572bcc34de94e, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:05.085534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:05.095891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1357/2712] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:05 2022] PUT /identity/v3/projects/ea5ec190e0204febae78d68c52038741/users/38d6a8be14f048ff824572bcc34de94e/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:05.107612 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.109982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.109982 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.135307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] MFA Rules not processed for user `38d6a8be14f048ff824572bcc34de94e`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:05.136546 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:05.206404 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1356/2713] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:05 2022] POST /identity/v3/auth/tokens => generated 3488 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:05.216813 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:05.273761 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e680ec-dd4c-495a-866a-f81adb253b98 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:05.277726 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:05.278369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.278650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.278925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.289444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:05.290931 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:05.300340 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1358/2714] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:05 2022] GET /identity/v3/auth/tokens => generated 3488 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:05.560847 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:05.571303 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad0634-6325-432c-ade8-c0320ca72a7e None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:05.575120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:05.575758 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:05.576082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:05.576364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:05.631309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:05.633328 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea4883-294f-40c2-9d96-2a3fbd30a500 service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:05.642745 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1357/2715] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:05 2022] GET /identity/v3/auth/tokens => generated 3419 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:09.044442 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:09.046534 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:09.119893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760665-5f4b-40f0-a367-5229eacdeb7f service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:09.127181 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:09.128890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:09.129324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:09.129603 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] PATH_INFO: `/v3/users/20b572ae03d94340bcc9c2601a135d01` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:09.131400 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b572ae03d94340bcc9c2601a135d01)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:09.134587 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:09.411918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b572ae03d94340bcc9c2601a135d01'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:09.412645 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b572ae03d94340bcc9c2601a135d01'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:09.419350 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b572ae03d94340bcc9c2601a135d01'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:09.545764 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b572ae03d94340bcc9c2601a135d01'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:09.560900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b572ae03d94340bcc9c2601a135d01'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:09.566970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1359/2716] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:09 2022] DELETE /identity/v3/users/20b572ae03d94340bcc9c2601a135d01 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:09.576369 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:09.576879 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:09.576965 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:09.595709 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:09.597035 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:09.656289 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1358/2717] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:09 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:09.668268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:09.669695 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:09.727535 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6bce9-a72d-4b6c-9a68-9ac38a56f84e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:09.731234 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:09.731874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:09.732187 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:09.732464 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:09.741685 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:09.743111 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:09.752469 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1360/2718] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:09 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:10.165728 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:10.167502 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:10.181363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12ffa-e9e9-4910-a673-fac7007eebdc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:10.186868 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:10.197915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:10.197915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:10.197915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] PATH_INFO: `/v3/projects/d57dc0c1022b4596bb0d28aad886b9be` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:10.197915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57dc0c1022b4596bb0d28aad886b9be)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:10.197915 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:10.351832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57dc0c1022b4596bb0d28aad886b9be', 'request_id': 'req-42a0c50f-5949-44dd-8135-ad626a12a322'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.357113 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57dc0c1022b4596bb0d28aad886b9be', 'request_id': 'req-42a0c50f-5949-44dd-8135-ad626a12a322'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.452278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57dc0c1022b4596bb0d28aad886b9be', 'request_id': 'req-42a0c50f-5949-44dd-8135-ad626a12a322'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.464011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] The token cache is being invalidate because project d57dc0c1022b4596bb0d28aad886b9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:10.467041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.467041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.467041 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1359/2719] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:10 2022] DELETE /identity/v3/projects/d57dc0c1022b4596bb0d28aad886b9be => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:10.470663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:10.481014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aaa2f-062b-4119-95d6-a3b00b14d964 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:10.538730 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:10.539578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:10.539862 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:10.540170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] PATH_INFO: `/v3/users/86dbf06371be49708268f19b60ecafda` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:10.541354 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dbf06371be49708268f19b60ecafda)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:10.543254 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:10.766438 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dbf06371be49708268f19b60ecafda'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.767126 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dbf06371be49708268f19b60ecafda'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.777611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dbf06371be49708268f19b60ecafda'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.916409 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dbf06371be49708268f19b60ecafda'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.931940 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dbf06371be49708268f19b60ecafda'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:10.936215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:10.937974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:10.939291 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1361/2720] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:10 2022] DELETE /identity/v3/users/86dbf06371be49708268f19b60ecafda => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:10.953454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0c50f-5949-44dd-8135-ad626a12a322 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:11.018832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:11.019679 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:11.020234 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:11.020650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] PATH_INFO: `/v3/users/e3d6728eac9b4b99abd7e055282c3e6f` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:11.021940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d6728eac9b4b99abd7e055282c3e6f)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:11.024956 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:11.278700 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d6728eac9b4b99abd7e055282c3e6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.289118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d6728eac9b4b99abd7e055282c3e6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.302467 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d6728eac9b4b99abd7e055282c3e6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.375576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:11.377103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:11.393652 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde62cf8-a4e2-4d4a-810c-d5c367079ec8 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:11.400869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:11.408781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:11.408781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:11.408781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] PATH_INFO: `/v3/projects/d4afd8c237a44d31a643bb098a787cdc` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:11.408781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4afd8c237a44d31a643bb098a787cdc)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:11.408781 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:11.414440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d6728eac9b4b99abd7e055282c3e6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.415197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d161b7a0-dfbf-47ab-bd42-486aba779ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d6728eac9b4b99abd7e055282c3e6f'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.424463 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1360/2721] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:10 2022] DELETE /identity/v3/users/e3d6728eac9b4b99abd7e055282c3e6f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:11.430158 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:11.430727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:11.431188 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:11.453370 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:11.454587 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:11.509984 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4afd8c237a44d31a643bb098a787cdc', 'request_id': 'req-e03a1e03-1664-4bd7-ae28-0e24be964e1d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.517130 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4afd8c237a44d31a643bb098a787cdc', 'request_id': 'req-e03a1e03-1664-4bd7-ae28-0e24be964e1d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.523589 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1361/2722] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:11 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:11.534954 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:11.535264 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:11.567450 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4afd8c237a44d31a643bb098a787cdc', 'request_id': 'req-e03a1e03-1664-4bd7-ae28-0e24be964e1d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.579690 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] The token cache is being invalidate because project d4afd8c237a44d31a643bb098a787cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:11.580024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.580849 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.583383 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1362/2723] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:11 2022] DELETE /identity/v3/projects/d4afd8c237a44d31a643bb098a787cdc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:11.588410 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:11.590499 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:11.603887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78364600-09d8-4025-a18d-09a9a7ed73fc None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:11.664802 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:11.665475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:11.665753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:11.666034 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:11.668183 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:11.669675 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a1e03-1664-4bd7-ae28-0e24be964e1d admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:11.674768 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:11.675505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:11.675774 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:11.676081 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] PATH_INFO: `/v3/users/213fe995f7724f69b2cc8c5794eda6b0` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:11.677817 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=213fe995f7724f69b2cc8c5794eda6b0)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:11.681882 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:11.682526 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:11.684211 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:11.696950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1362/2724] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:11 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:11.879506 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213fe995f7724f69b2cc8c5794eda6b0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.880299 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213fe995f7724f69b2cc8c5794eda6b0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.887188 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213fe995f7724f69b2cc8c5794eda6b0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.967521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213fe995f7724f69b2cc8c5794eda6b0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.985133 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213fe995f7724f69b2cc8c5794eda6b0'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:11.993343 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1363/2725] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:11 2022] DELETE /identity/v3/users/213fe995f7724f69b2cc8c5794eda6b0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:12.238379 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.240246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.257523 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75339-d612-4229-89de-0e41dfe96a05 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:12.325025 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:12.325785 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.326063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.326338 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] PATH_INFO: `/v3/projects/71d421fd2f1d49e2b4d304361deb4d6b` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.327579 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d421fd2f1d49e2b4d304361deb4d6b)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:12.329543 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:12.447843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d421fd2f1d49e2b4d304361deb4d6b', 'request_id': 'req-d81721f3-7aae-4a34-bde9-09ff47216f76'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.453618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d421fd2f1d49e2b4d304361deb4d6b', 'request_id': 'req-d81721f3-7aae-4a34-bde9-09ff47216f76'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.469135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.470663 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.485711 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82ae20-41b0-4663-b93b-55fb30dc7eb6 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:12.544978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d421fd2f1d49e2b4d304361deb4d6b', 'request_id': 'req-d81721f3-7aae-4a34-bde9-09ff47216f76'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.557340 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] The token cache is being invalidate because project 71d421fd2f1d49e2b4d304361deb4d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:12.557725 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:12.558203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.558563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.558665 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.559148 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.559461 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] PATH_INFO: `/v3/projects/263ea453139b42c4b781ac63a6e79c40` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.560561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1363/2726] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:12 2022] DELETE /identity/v3/projects/71d421fd2f1d49e2b4d304361deb4d6b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:12.560846 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263ea453139b42c4b781ac63a6e79c40)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:12.562893 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:12.564657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.566082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.580440 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81721f3-7aae-4a34-bde9-09ff47216f76 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:12.586960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:12.588046 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.588332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.588654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] PATH_INFO: `/v3/users/38d6a8be14f048ff824572bcc34de94e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.590582 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d6a8be14f048ff824572bcc34de94e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:12.593203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:12.672923 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263ea453139b42c4b781ac63a6e79c40', 'request_id': 'req-7526d7f2-96f6-4ddd-96c7-cb00963be933'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.679840 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263ea453139b42c4b781ac63a6e79c40', 'request_id': 'req-7526d7f2-96f6-4ddd-96c7-cb00963be933'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.750542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263ea453139b42c4b781ac63a6e79c40', 'request_id': 'req-7526d7f2-96f6-4ddd-96c7-cb00963be933'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.761909 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] The token cache is being invalidate because project 263ea453139b42c4b781ac63a6e79c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:12.762369 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.763015 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-7526d7f2-96f6-4ddd-96c7-cb00963be933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.764605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1364/2727] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:12 2022] DELETE /identity/v3/projects/263ea453139b42c4b781ac63a6e79c40 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:12.770119 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091b2f-8085-43a8-954e-a6a5b2309a78 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.770470 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091b2f-8085-43a8-954e-a6a5b2309a78 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.770745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091b2f-8085-43a8-954e-a6a5b2309a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.789337 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-cc091b2f-8085-43a8-954e-a6a5b2309a78 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:12.790601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-cc091b2f-8085-43a8-954e-a6a5b2309a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.803797 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d6a8be14f048ff824572bcc34de94e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.810573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d6a8be14f048ff824572bcc34de94e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.822857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d6a8be14f048ff824572bcc34de94e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.851238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1365/2728] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:12.859166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.859451 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.859724 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.878151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:12.879365 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:12.888191 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1366/2729] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:12 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:12.892378 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.901601 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44435-1101-48fd-bdb8-4eb5a0d7f508 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:12.904448 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d6a8be14f048ff824572bcc34de94e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.905132 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d6a8be14f048ff824572bcc34de94e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:12.906355 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:12.907065 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:12.907739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:12.907739 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:12.908437 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79742) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:14:12.908749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:12.910563 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:12.912749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1364/2730] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:12 2022] DELETE /identity/v3/users/38d6a8be14f048ff824572bcc34de94e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:12.923054 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1367/2731] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:14:12.927565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:12.929563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.000992 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd259a1-bc4e-4906-80dc-8762e1e6359e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.006139 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.007711 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.008026 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.008312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.009083 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.012398 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.120918 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1365/2732] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:12 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:14:13.131382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.142396 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28bc2-1a93-434c-beb3-450a3ad9ed1f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.202352 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.203204 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.203486 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.203777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.204519 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.206465 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.310659 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1368/2733] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:13.315202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.327204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16d97-cdf3-40fb-ae18-a341e0ad7691 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.333557 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.334749 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.334897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.335270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.335834 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.336836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.337238 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.338484 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.351892 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718fa89-85ef-49d0-ab1f-92fd65c7e25c admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.352209 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1366/2734] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:13.358816 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.359211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.360841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.360841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.360841 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] PATH_INFO: `/v3/projects/ea5ec190e0204febae78d68c52038741` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.362117 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5ec190e0204febae78d68c52038741)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.364788 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.376270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf858-f59f-47d6-98ba-eee6fc66bf8b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.383483 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.385384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.385384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.385384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.385654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.387054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.399324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1367/2735] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:13.404457 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.416229 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ef78e-0a32-49c4-9900-b1c5d47fc629 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.421327 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.422202 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] REQUEST_METHOD: `PUT` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.422487 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.422766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] PATH_INFO: `/v3/projects/42e977ea9e1f45ddbba1e5cfc40616be/users/d45e3859fd364a48b40248e2a383121d/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.440005 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e977ea9e1f45ddbba1e5cfc40616be, user_id=d45e3859fd364a48b40248e2a383121d, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.442693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2839ef-27fa-4316-9e1a-2b65c1724563 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.541029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1368/2736] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:13 2022] PUT /identity/v3/projects/42e977ea9e1f45ddbba1e5cfc40616be/users/d45e3859fd364a48b40248e2a383121d/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:13.546564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.546869 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.547079 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.553484 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5ec190e0204febae78d68c52038741', 'request_id': 'req-f7230c69-b8fb-4462-8bef-11553fd58c98'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:13.562035 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5ec190e0204febae78d68c52038741', 'request_id': 'req-f7230c69-b8fb-4462-8bef-11553fd58c98'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:13.566375 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:13.567735 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.630368 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1369/2737] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:13.641215 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.642208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5ec190e0204febae78d68c52038741', 'request_id': 'req-f7230c69-b8fb-4462-8bef-11553fd58c98'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:13.642650 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.654824 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] The token cache is being invalidate because project ea5ec190e0204febae78d68c52038741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:13.655102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:13.659134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7230c69-b8fb-4462-8bef-11553fd58c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:13.659134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1369/2738] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:13 2022] DELETE /identity/v3/projects/ea5ec190e0204febae78d68c52038741 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 02:14:13.665209 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047aa3-ecc0-460b-97de-fec480a5889c None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.665706 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047aa3-ecc0-460b-97de-fec480a5889c None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.666221 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d047aa3-ecc0-460b-97de-fec480a5889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.691334 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-3d047aa3-ecc0-460b-97de-fec480a5889c None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:13.692576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-3d047aa3-ecc0-460b-97de-fec480a5889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.701026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1370/2739] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:13.711014 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.711330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.711561 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.712336 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75fb11-0604-428d-a302-034b945b32ce None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.716243 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.716897 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.717182 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.717460 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.719341 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.733265 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.734742 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.735298 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:13.736821 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:13.745203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1370/2740] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:13 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:13.747794 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1371/2741] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:13.752385 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.766782 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426cec-35e7-4391-a851-61aa0ebe54d3 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.772766 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.773715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.774227 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.774431 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.775058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:14:13.775372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.777114 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.796635 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1371/2742] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 02:14:13.801958 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.812478 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062fb0e-8d02-457d-8368-dc37d0b11be9 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.817370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.818043 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.818323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.819523 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.820678 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.822585 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:13.898756 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1372/2743] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:14:13.904509 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:13.918951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa47a8a-03d0-4480-9445-eaa353dd1592 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:13.983654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:13.984533 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:13.984813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:13.985088 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:13.985781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:13.987693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.084057 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1372/2744] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:13 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:14.089457 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.101586 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06489b-2008-4f8c-8fb2-b127c01a3af0 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.106916 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.107588 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.107874 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.108169 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.109045 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.110740 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.122309 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1373/2745] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:14.126649 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.138413 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbea99-0fea-4297-813d-9162c961a14b admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.152097 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.153011 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.153405 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.153798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.154690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.156896 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6ef9-7881-43bd-a244-8677806809e7 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.171540 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1373/2746] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:14.176335 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.183597 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665213d2-bbed-472c-be70-eadcb04f576a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.188459 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.189391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.189619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.189890 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] PATH_INFO: `/v3/projects/fa0a6d3c3de94a4383df33de907a1878/users/ba0a25f2a49e46aeaab3ff9d71812908/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.208860 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0a6d3c3de94a4383df33de907a1878, user_id=ba0a25f2a49e46aeaab3ff9d71812908, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.211707 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.390891 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1374/2747] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:14 2022] PUT /identity/v3/projects/fa0a6d3c3de94a4383df33de907a1878/users/ba0a25f2a49e46aeaab3ff9d71812908/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:14.404889 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.405423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.405884 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.440007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] MFA Rules not processed for user `ba0a25f2a49e46aeaab3ff9d71812908`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:14.441626 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:14.513059 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1374/2748] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:14 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:14.518103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.605993 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c6d16-4e10-44fd-beee-657e21cdf837 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.615858 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.616574 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.616859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.617137 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.617837 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.619818 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.706789 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1375/2749] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:14 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:14.711898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.723690 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138baee2-32c1-41e2-806b-20752198c0a4 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.793074 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.793752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.794037 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.794312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.795063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.797357 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.893608 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1375/2750] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:14 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:14.898048 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.908608 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65b81-9dcd-4ae7-9056-1daa2ae3388f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.914244 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.914955 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.921322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.921322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.921322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.921322 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.929316 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1376/2751] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:14.933473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.944680 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7b71-d1ed-46e4-9f8f-cfff3d7284b0 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.949633 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.950307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.950588 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.955923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:14.955923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:14.955923 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7ff5-d89e-445c-8385-27df2530ec45 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:14.964713 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1376/2752] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:14.968991 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:14.980549 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed368b32-fe22-4e66-986a-411a3a257841 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:14.985526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:14.986443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:14.986778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:14.987051 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] PATH_INFO: `/v3/projects/c9456c631a084f1cbc07d17a744644bb/users/5158f92987c6496484d545d81406eb41/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.003093 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9456c631a084f1cbc07d17a744644bb, user_id=5158f92987c6496484d545d81406eb41, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.005814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4c158-ca25-4aa2-aed9-1b3c81a7a2a6 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.081900 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1377/2753] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:14 2022] PUT /identity/v3/projects/c9456c631a084f1cbc07d17a744644bb/users/5158f92987c6496484d545d81406eb41/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:15.094361 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.094651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.094934 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.127585 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] MFA Rules not processed for user `5158f92987c6496484d545d81406eb41`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:15.129518 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:15.146373 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.147207 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.147521 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.182712 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] MFA Rules not processed for user `d45e3859fd364a48b40248e2a383121d`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:15.184069 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:15.221663 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1377/2754] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:15 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:15.227203 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.288607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1378/2755] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:15 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:15.297604 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.299542 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:15.311070 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497b3f6-41f6-419f-b971-e3ae6152d8b0 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.316302 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.316957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.317548 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.317888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] PATH_INFO: `/v3/projects` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.319313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.321423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.368196 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e602-cf95-4e7c-9fc3-62ee9bfbfcae None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.373113 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.373760 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.374042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.374324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.384831 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.386252 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.395268 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1379/2756] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:15 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:15.530351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1378/2757] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:15.534648 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.545861 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fa3b-5ac8-4d23-9a99-9d5cbb93dccd service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.602822 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.603480 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.603757 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.604055 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] PATH_INFO: `/v3/users` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.604745 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.606637 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.739185 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1380/2758] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:15 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 02:14:15.743957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.754552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbafa79-eb45-4183-b71c-bef49c3c740a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.760055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.760788 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.761145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.761466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.762236 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.763935 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.775065 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1379/2759] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:15.780134 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.790611 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e202e2-c6b5-4590-b735-da8dbb25b141 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.795284 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.796205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.796473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.796746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] PATH_INFO: `/v3/projects/ae734c5c95724df09064e57ed6d5e045/users/e9692aa4040146cd8ee107bc5c1e1282/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.813377 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae734c5c95724df09064e57ed6d5e045, user_id=e9692aa4040146cd8ee107bc5c1e1282, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.816023 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:15.892647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1381/2760] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:15 2022] PUT /identity/v3/projects/ae734c5c95724df09064e57ed6d5e045/users/e9692aa4040146cd8ee107bc5c1e1282/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:15.896888 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:15.907344 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e494cb-78df-40db-a764-0c12485d1d70 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:15.987764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:15.988466 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:15.988750 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:15.989029 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:15.989749 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:15.991894 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffbf66-01ab-42f9-9d76-9def3976b28b admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:16.001722 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1380/2761] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 02:14:16.005963 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:16.017466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738f10-222b-47cf-bd51-47558052354f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:16.022488 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:16.023382 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:16.024167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:16.024167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] PATH_INFO: `/v3/projects/ae734c5c95724df09064e57ed6d5e045/users/e9692aa4040146cd8ee107bc5c1e1282/roles/696ce32a0d804992a93645d6906b0119` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:16.026415 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae734c5c95724df09064e57ed6d5e045, user_id=e9692aa4040146cd8ee107bc5c1e1282, role_id=696ce32a0d804992a93645d6906b0119)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:16.029050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:16.047067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1382/2762] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:16 2022] PUT /identity/v3/projects/ae734c5c95724df09064e57ed6d5e045/users/e9692aa4040146cd8ee107bc5c1e1282/roles/696ce32a0d804992a93645d6906b0119 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:16.064307 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeab2-caae-4890-bd89-79646ec46972 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:16.064947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeab2-caae-4890-bd89-79646ec46972 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:16.065235 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbeab2-caae-4890-bd89-79646ec46972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:16.092973 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-b8bbeab2-caae-4890-bd89-79646ec46972 None None] MFA Rules not processed for user `e9692aa4040146cd8ee107bc5c1e1282`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:16.094221 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b8bbeab2-caae-4890-bd89-79646ec46972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:16.171259 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1381/2763] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:16 2022] POST /identity/v3/auth/tokens => generated 3462 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:16.182800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:16.238598 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de37da-75cf-45ba-bbee-ae85b9c1c5e5 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:16.243205 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:16.243848 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:16.244167 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:16.244444 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:16.302746 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:16.305019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:16.314735 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1383/2764] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:16 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:17.187012 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:17.187607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:17.187607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:17.205278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] MFA Rules not processed for user `d45e3859fd364a48b40248e2a383121d`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:17.206470 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:17.262109 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1382/2765] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:17 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:18.392694 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:18.402885 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac845d03-8615-4336-b9d5-e968fe8528eb service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:18.407387 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:18.408370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:18.408370 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:18.408609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:18.477766 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:18.479219 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:18.488627 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1384/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:18 2022] GET /identity/v3/auth/tokens => generated 3397 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:19.421301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:19.422707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:19.491534 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68dfd6-217a-4ba0-af70-5806ac548afa None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:19.496601 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:19.497252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:19.497537 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:19.497815 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:19.499594 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:19.511250 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:19.512857 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:19.523739 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1383/2767] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:19 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:20.323567 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:20.331166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c51ee-a00d-431b-88d1-3169ceaaef2b service cinder] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:20.335102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:20.335733 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:20.336046 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:20.336320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:20.345729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:20.347483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caac74-dad2-42ee-bc3d-ca80aba129cd service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:20.360050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1385/2768] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:20 2022] GET /identity/v3/auth/tokens => generated 3462 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:25.139704 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:25.205859 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccd55-d150-43cb-9765-bd580dbf7df4 service placement] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:25.211082 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1059596-661d-4683-927f-101471110a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:25.211993 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059596-661d-4683-927f-101471110a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:25.212286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059596-661d-4683-927f-101471110a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:25.212564 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059596-661d-4683-927f-101471110a04 admin admin] PATH_INFO: `/v3/users/ba0a25f2a49e46aeaab3ff9d71812908` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:25.213773 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1059596-661d-4683-927f-101471110a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0a25f2a49e46aeaab3ff9d71812908)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:25.215701 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1059596-661d-4683-927f-101471110a04 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:25.484651 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0a25f2a49e46aeaab3ff9d71812908'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:25.491860 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0a25f2a49e46aeaab3ff9d71812908'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:25.504140 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0a25f2a49e46aeaab3ff9d71812908'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:25.589978 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0a25f2a49e46aeaab3ff9d71812908'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:25.590597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0a25f2a49e46aeaab3ff9d71812908'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:25.597061 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1384/2769] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:25 2022] DELETE /identity/v3/users/ba0a25f2a49e46aeaab3ff9d71812908 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:25.603157 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:25.603667 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:25.603769 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:25.621161 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:25.622509 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:25.686686 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1386/2770] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:25 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:25.697141 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:25.698574 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:25.763099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1059596-661d-4683-927f-101471110a04 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:25.768258 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:25.769210 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:25.769629 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:25.770047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:25.784301 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:25.785738 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:25.796951 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1385/2771] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:14:26.401324 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:26.402926 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:26.416778 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdca71-2fb8-492b-b0b8-10a41305ed6e None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:26.422721 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:26.423771 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:26.424240 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:26.424591 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] PATH_INFO: `/v3/projects/fa0a6d3c3de94a4383df33de907a1878` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:26.426605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0a6d3c3de94a4383df33de907a1878)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:26.429763 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:26.565973 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0a6d3c3de94a4383df33de907a1878', 'request_id': 'req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.573330 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0a6d3c3de94a4383df33de907a1878', 'request_id': 'req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.641619 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0a6d3c3de94a4383df33de907a1878', 'request_id': 'req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.654589 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] The token cache is being invalidate because project fa0a6d3c3de94a4383df33de907a1878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:26.654868 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.655584 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.657201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1387/2772] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:26 2022] DELETE /identity/v3/projects/fa0a6d3c3de94a4383df33de907a1878 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:26.661422 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:26.672607 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b76da-84b5-440e-9a3d-7794be844273 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:26.733764 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:26.734656 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:26.734937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:26.735216 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] PATH_INFO: `/v3/users/5158f92987c6496484d545d81406eb41` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:26.736473 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5158f92987c6496484d545d81406eb41)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:26.738407 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:26.971138 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5158f92987c6496484d545d81406eb41'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.980561 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5158f92987c6496484d545d81406eb41'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:26.994424 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5158f92987c6496484d545d81406eb41'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.075781 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5158f92987c6496484d545d81406eb41'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.076567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5158f92987c6496484d545d81406eb41'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.083232 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1386/2773] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:26 2022] DELETE /identity/v3/users/5158f92987c6496484d545d81406eb41 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:27.636751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:27.642239 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:27.652186 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a261a4-f3f8-4680-9b6b-3f14ffd879c7 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:27.713696 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:27.714576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:27.722481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:27.722481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] PATH_INFO: `/v3/projects/c9456c631a084f1cbc07d17a744644bb` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:27.722481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9456c631a084f1cbc07d17a744644bb)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:27.722481 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:27.846102 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9456c631a084f1cbc07d17a744644bb', 'request_id': 'req-29f3ed99-f483-4720-9b96-7f1be6982c7a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.853151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9456c631a084f1cbc07d17a744644bb', 'request_id': 'req-29f3ed99-f483-4720-9b96-7f1be6982c7a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.950168 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9456c631a084f1cbc07d17a744644bb', 'request_id': 'req-29f3ed99-f483-4720-9b96-7f1be6982c7a'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.962443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] The token cache is being invalidate because project c9456c631a084f1cbc07d17a744644bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:27.963005 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.968751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:27.968751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1388/2774] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:27 2022] DELETE /identity/v3/projects/c9456c631a084f1cbc07d17a744644bb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:27.969246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:27.970717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:27.983887 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386bef-b572-43e3-93ee-33b57f589b62 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:28.043743 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:28.044654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:28.044937 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:28.045246 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] PATH_INFO: `/v3/users/e9692aa4040146cd8ee107bc5c1e1282` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:28.046423 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9692aa4040146cd8ee107bc5c1e1282)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:28.048591 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:28.229832 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9692aa4040146cd8ee107bc5c1e1282'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:28.236778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9692aa4040146cd8ee107bc5c1e1282'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:28.250556 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9692aa4040146cd8ee107bc5c1e1282'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:28.315667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9692aa4040146cd8ee107bc5c1e1282'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:28.316475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-3d3844c3-190c-470d-87a7-66d07dc0b792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9692aa4040146cd8ee107bc5c1e1282'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:28.323520 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1387/2775] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:14:27 2022] DELETE /identity/v3/users/e9692aa4040146cd8ee107bc5c1e1282 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:28.808922 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:28.810547 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:28.825515 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3ed99-f483-4720-9b96-7f1be6982c7a admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:28.889953 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:28.890819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:28.891104 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:28.891392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] PATH_INFO: `/v3/projects/ae734c5c95724df09064e57ed6d5e045` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:28.892630 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae734c5c95724df09064e57ed6d5e045)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:28.894716 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.001755 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae734c5c95724df09064e57ed6d5e045', 'request_id': 'req-64ac544d-2b21-43c4-9486-19096c058de2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:29.008700 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae734c5c95724df09064e57ed6d5e045', 'request_id': 'req-64ac544d-2b21-43c4-9486-19096c058de2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:29.075839 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae734c5c95724df09064e57ed6d5e045', 'request_id': 'req-64ac544d-2b21-43c4-9486-19096c058de2'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:29.087331 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] The token cache is being invalidate because project ae734c5c95724df09064e57ed6d5e045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:14:29.087620 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:29.088279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-64ac544d-2b21-43c4-9486-19096c058de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:14:29.089814 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1389/2776] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:14:28 2022] DELETE /identity/v3/projects/ae734c5c95724df09064e57ed6d5e045 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:29.097618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.100372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.100372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.116645 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:29.117845 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:29.182030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1388/2777] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 02:14:29.190571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.190888 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.191173 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.215323 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:29.216738 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:29.225793 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1390/2778] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:29.230245 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.240810 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3ad10-b624-4c3e-a3c2-b83caf33741f None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.245753 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.246411 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.246689 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.246960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.247684 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79743) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 02:14:29.248000 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.249606 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.263169 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1389/2779] 10.222.0.79 () {58 vars in 1152 bytes} [Fri Jan 28 02:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 02:14:29.267776 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.277625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f41d-8106-489c-ad5f-05b5121f5254 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.282320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.284341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.284341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.284341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] PATH_INFO: `/v3/projects` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.284341 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.286184 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.379819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1391/2780] 10.222.0.79 () {60 vars in 1152 bytes} [Fri Jan 28 02:14:29 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:29.384110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.394380 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a400-3e28-4314-b4b1-728ac542bfbf admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.452047 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.452712 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.452999 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.453272 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] PATH_INFO: `/v3/users` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.453958 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.455914 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.533322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1390/2781] 10.222.0.79 () {60 vars in 1143 bytes} [Fri Jan 28 02:14:29 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 02:14:29.539855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.553040 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22e32-5da7-4748-866c-797dcfa75984 admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.558998 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.559687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.559982 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.560279 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.561009 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.562670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.576024 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1392/2782] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:29.580269 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.591244 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbfb10-46e8-48aa-b305-ef070842840c admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.596013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.596677 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.596959 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.597494 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.598213 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.599886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220581a-3757-4bc4-968d-80ffcfc52002 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.610333 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1391/2783] 10.222.0.79 () {58 vars in 1121 bytes} [Fri Jan 28 02:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 02:14:29.614729 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.624838 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25931-482d-4b5d-a47d-31b99f610e5f admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.629538 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.630970 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.631223 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.631500 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] PATH_INFO: `/v3/projects/dfdaf77bcf5a4358b657de79f178fa6e/users/6a44eea6c44247d0a40f007026b1fb93/roles/e41adb3856204ccab507dffc30b49ede` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.647165 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdaf77bcf5a4358b657de79f178fa6e, user_id=6a44eea6c44247d0a40f007026b1fb93, role_id=e41adb3856204ccab507dffc30b49ede)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.650026 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.755443 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1393/2784] 10.222.0.79 () {60 vars in 1482 bytes} [Fri Jan 28 02:14:29 2022] PUT /identity/v3/projects/dfdaf77bcf5a4358b657de79f178fa6e/users/6a44eea6c44247d0a40f007026b1fb93/roles/e41adb3856204ccab507dffc30b49ede => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:14:29.763324 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be265e-9176-4c59-9673-e2fb58bfec7a None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.763618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be265e-9176-4c59-9673-e2fb58bfec7a None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.763898 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be265e-9176-4c59-9673-e2fb58bfec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.782976 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-e3be265e-9176-4c59-9673-e2fb58bfec7a None None] MFA Rules not processed for user `3562fb362d174fe499304c112522dca6`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:29.784447 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-e3be265e-9176-4c59-9673-e2fb58bfec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:29.848568 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1392/2785] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:29.860208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:29.861950 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:29.925210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb17dd-2366-4ff8-b8be-3dde0b70ca1e admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:29.929211 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:29.929855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:29.930138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:29.930413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:29.939606 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:29.941565 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:29.952250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1394/2786] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:29 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:31.335309 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c8e1-d1c4-4a11-91b9-d5bb4a225d77 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:31.335800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c8e1-d1c4-4a11-91b9-d5bb4a225d77 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:31.335800 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c8e1-d1c4-4a11-91b9-d5bb4a225d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:31.367908 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-21e0c8e1-d1c4-4a11-91b9-d5bb4a225d77 None None] MFA Rules not processed for user `6a44eea6c44247d0a40f007026b1fb93`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:31.369159 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-21e0c8e1-d1c4-4a11-91b9-d5bb4a225d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:31.436063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1393/2787] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:31 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:31.446441 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:31.448042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:31.506826 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a58e-0fa2-4836-b926-56619a2a655c service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:31.510787 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:31.511578 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:31.511859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:31.512226 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:31.522099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:31.523541 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfa8f0-ee2b-4b82-8e0b-caf38597664c service cinder] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:31.532823 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1395/2788] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:31 2022] GET /identity/v3/auth/tokens => generated 3403 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:33.298295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77b44a-ed48-484e-97f2-e11df0121cf8 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:33.298905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77b44a-ed48-484e-97f2-e11df0121cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:33.298905 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77b44a-ed48-484e-97f2-e11df0121cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:33.316772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-bb77b44a-ed48-484e-97f2-e11df0121cf8 None None] MFA Rules not processed for user `6a44eea6c44247d0a40f007026b1fb93`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:33.318512 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-bb77b44a-ed48-484e-97f2-e11df0121cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:33.325790 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1394/2789] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:33 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:37.083050 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:37.083580 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:37.083676 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:37.102272 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] MFA Rules not processed for user `d45e3859fd364a48b40248e2a383121d`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:37.103516 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:37.165141 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1396/2790] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:37 2022] POST /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:41.871806 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] REQUEST_METHOD: `POST` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:41.872382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:41.872382 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:41.890329 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.auth.core [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] MFA Rules not processed for user `4cdbf7d369e4437eae7a36529d6cd623`. Rule list: `[]` (Enabled: `True`). {{(pid=79743) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:14:41.891567 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:41.949178 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1395/2791] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:14:41 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:14:44.117579 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:44.128802 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f6db-d778-4792-9e24-3f4e80e40303 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:44.134021 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:44.134825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:44.135210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:44.135613 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:44.138616 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:44.204925 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:44.206902 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:44.219526 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1397/2792] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:44 2022] GET /identity/v3/auth/tokens => generated 3391 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:14:52.352784 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:14:52.363007 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0bb3f-7851-42e2-b1f3-c04933dd64f3 None None] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:14:52.366727 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:14:52.367360 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:14:52.367671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:14:52.367950 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:14:52.369877 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:14:52.385230 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:14:52.387063 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:14:52.398332 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1396/2793] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:14:52 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:15:01.372621 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:01.374140 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:01.390576 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e462-7f93-4f28-8410-d5106b94de48 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:01.396198 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:01.397138 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:01.397417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:01.397687 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] PATH_INFO: `/v3/users/bb5c39b83f31473696c9b249ab49d780` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:01.398877 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5c39b83f31473696c9b249ab49d780)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:01.400857 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:01.637392 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5c39b83f31473696c9b249ab49d780'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:01.637986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5c39b83f31473696c9b249ab49d780'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:01.644999 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5c39b83f31473696c9b249ab49d780'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:01.760483 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5c39b83f31473696c9b249ab49d780'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:01.776471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5c39b83f31473696c9b249ab49d780'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:01.785195 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1398/2794] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:15:01 2022] DELETE /identity/v3/users/bb5c39b83f31473696c9b249ab49d780 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:02.048263 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:02.059009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dd9e2-d515-4489-ba27-4de57e5fa793 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:02.114314 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:02.115177 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:02.115453 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:02.115726 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] PATH_INFO: `/v3/projects/a55dde8892fa47bd9941bb1ce9aa3673` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:02.116947 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55dde8892fa47bd9941bb1ce9aa3673)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:02.118843 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:02.237049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55dde8892fa47bd9941bb1ce9aa3673', 'request_id': 'req-862c8c0c-095b-471c-b661-1e64966cf866'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.244814 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55dde8892fa47bd9941bb1ce9aa3673', 'request_id': 'req-862c8c0c-095b-471c-b661-1e64966cf866'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.349255 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55dde8892fa47bd9941bb1ce9aa3673', 'request_id': 'req-862c8c0c-095b-471c-b661-1e64966cf866'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.360517 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] The token cache is being invalidate because project a55dde8892fa47bd9941bb1ce9aa3673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:15:02.360831 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.361427 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.363039 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1397/2795] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:15:02 2022] DELETE /identity/v3/projects/a55dde8892fa47bd9941bb1ce9aa3673 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:02.367670 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:02.369231 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:02.383550 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380cb71-bd58-43cc-946b-9cbb04eb740b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:02.445020 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:02.445875 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:02.446158 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:02.446434 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] PATH_INFO: `/v3/users/a58d84f34a0745d7b8229fd9caf5c9d5` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:02.447609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58d84f34a0745d7b8229fd9caf5c9d5)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:02.449558 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:02.609321 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58d84f34a0745d7b8229fd9caf5c9d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.610012 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58d84f34a0745d7b8229fd9caf5c9d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.618143 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58d84f34a0745d7b8229fd9caf5c9d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.691151 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58d84f34a0745d7b8229fd9caf5c9d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.703718 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-f7672865-5796-4c65-86b3-45acab3174de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58d84f34a0745d7b8229fd9caf5c9d5'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:02.709825 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1399/2796] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:15:02 2022] DELETE /identity/v3/users/a58d84f34a0745d7b8229fd9caf5c9d5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:02.939710 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:02.941249 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:02.955707 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8c0c-095b-471c-b661-1e64966cf866 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:03.032890 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:03.034100 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:03.034381 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:03.034654 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] PATH_INFO: `/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:03.036597 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] RBAC: Authorizing `identity:delete_project(project_id=463ff1c26e4d4d4b8c8994c34e1f7189)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:03.038507 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:03.157798 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463ff1c26e4d4d4b8c8994c34e1f7189', 'request_id': 'req-debec4a8-f671-4e03-9960-9d3a504f033e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:03.164998 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463ff1c26e4d4d4b8c8994c34e1f7189', 'request_id': 'req-debec4a8-f671-4e03-9960-9d3a504f033e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:03.241049 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463ff1c26e4d4d4b8c8994c34e1f7189', 'request_id': 'req-debec4a8-f671-4e03-9960-9d3a504f033e'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:03.252952 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] The token cache is being invalidate because project 463ff1c26e4d4d4b8c8994c34e1f7189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:15:03.253240 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:03.253903 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:03.256691 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1398/2797] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:15:02 2022] DELETE /identity/v3/projects/463ff1c26e4d4d4b8c8994c34e1f7189 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:04.442000 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd87b-02f1-4d4e-95bd-91651987c28a None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:04.443042 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd87b-02f1-4d4e-95bd-91651987c28a None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:04.443242 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd87b-02f1-4d4e-95bd-91651987c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:04.461413 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-2bdcd87b-02f1-4d4e-95bd-91651987c28a None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:15:04.462800 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-2bdcd87b-02f1-4d4e-95bd-91651987c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:04.523851 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1400/2798] 10.222.0.79 () {58 vars in 1009 bytes} [Fri Jan 28 02:15:04 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:15:04.651252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:04.652960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:04.724669 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debec4a8-f671-4e03-9960-9d3a504f033e admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:04.730030 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:04.731630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:04.731630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:04.731630 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:04.740099 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:04.741686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:04.750364 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1399/2799] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:15:23.546417 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:23.547084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:23.547084 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:23.568713 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] MFA Rules not processed for user `ab844b86bc184fa8b6da36559bea546e`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:15:23.569932 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:23.577594 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1401/2800] 10.222.0.79 () {58 vars in 967 bytes} [Fri Jan 28 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:15:23.591278 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:23.602197 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d8ca-af09-418c-89fc-a5d809e718cc service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:23.607539 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a31cb414c8c418b96621a93ba3fff06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:23.608201 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:23.608488 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:23.608765 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:23.616995 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:23.618717 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:23.626723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1400/2801] 10.222.0.79 () {60 vars in 1384 bytes} [Fri Jan 28 02:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 02:15:28.842427 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:28.843884 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:28.918146 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979c60e-959c-446c-9042-196878ca2ee6 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:28.922689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:28.923540 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:28.923819 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:28.924120 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] PATH_INFO: `/v3/users/d45e3859fd364a48b40248e2a383121d` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:28.925303 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45e3859fd364a48b40248e2a383121d)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:28.927918 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:29.099533 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45e3859fd364a48b40248e2a383121d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.104934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45e3859fd364a48b40248e2a383121d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.107751 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45e3859fd364a48b40248e2a383121d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.160777 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45e3859fd364a48b40248e2a383121d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.173811 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5cd89cca-02e6-4474-8156-d4ca75629cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45e3859fd364a48b40248e2a383121d'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.181066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1402/2802] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:15:28 2022] DELETE /identity/v3/users/d45e3859fd364a48b40248e2a383121d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:29.418659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:15:29.429957 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a28705-885e-4fb6-9a34-084e947cdfbd service swift] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:15:29.486417 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:15:29.487261 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:29.487541 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:29.487813 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] PATH_INFO: `/v3/projects/42e977ea9e1f45ddbba1e5cfc40616be` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:29.489013 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e977ea9e1f45ddbba1e5cfc40616be)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:15:29.491391 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:15:29.594403 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e977ea9e1f45ddbba1e5cfc40616be', 'request_id': 'req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.600752 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e977ea9e1f45ddbba1e5cfc40616be', 'request_id': 'req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.663530 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e977ea9e1f45ddbba1e5cfc40616be', 'request_id': 'req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.675004 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] The token cache is being invalidate because project 42e977ea9e1f45ddbba1e5cfc40616be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:15:29.675287 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.677160 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:15:29.677562 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1401/2803] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:15:29 2022] DELETE /identity/v3/projects/42e977ea9e1f45ddbba1e5cfc40616be => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:15:53.499176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:15:53.500229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:15:53.500229 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:15:53.518419 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] MFA Rules not processed for user `6a44eea6c44247d0a40f007026b1fb93`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:15:53.519607 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:15:53.574859 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1403/2804] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:15:53 2022] POST /identity/v3/auth/tokens => generated 3403 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:16:01.241356 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:16:01.246280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:01.312397 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7bd9-d049-44de-a5f1-8f2a4ee3e7bd admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:16:01.316886 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:16:01.317910 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:16:01.318200 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:16:01.318478 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:16:01.320351 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:01.399147 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:16:01.400664 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:16:01.413430 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1402/2805] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:16:01 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:16:02.584067 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:16:02.593829 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192b56-9bb0-426a-8a1a-47255a12e7db None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:16:02.597503 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:16:02.598744 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:16:02.599047 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:16:02.599320 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:16:02.601124 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:02.614911 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:16:02.616371 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:16:02.627609 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1404/2806] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:16:02 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:16:33.521339 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:16:33.522826 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:33.540152 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2a23-a9ff-46e0-af06-f60bed301711 service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:16:33.546322 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:16:33.548252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:16:33.548252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:16:33.548252 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:16:33.550454 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:33.563940 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:16:33.566475 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:16:33.578055 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1403/2807] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:16:33 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:16:58.739750 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:16:58.748924 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e2f4f-2c4a-4c25-a9a8-7141946f8f7c service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:16:58.752759 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:16:58.753397 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:16:58.753677 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:16:58.753949 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:16:58.755705 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:58.765978 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:16:58.768078 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:16:58.777170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1405/2808] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:16:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 02:16:59.243416 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:16:59.245045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:59.318618 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a8c67-b021-4d64-bb4d-87c88130679e service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:16:59.322836 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8912268c49fc4532a9b920995b286ed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:16:59.323569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:16:59.323852 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:16:59.324168 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:16:59.326118 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:16:59.409771 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:16:59.411552 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:16:59.423084 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1404/2809] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:16:59 2022] GET /identity/v3/auth/tokens => generated 3399 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:17:04.314063 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:04.315571 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:04.386135 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b66547-ae85-4769-b3f2-6a14a901e4a7 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:04.390702 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:04.391554 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:04.392568 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:04.393072 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] PATH_INFO: `/v3/users/6a44eea6c44247d0a40f007026b1fb93` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:04.394375 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a44eea6c44247d0a40f007026b1fb93)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:04.396317 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:04.617983 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a44eea6c44247d0a40f007026b1fb93'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:04.618647 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a44eea6c44247d0a40f007026b1fb93'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:04.625429 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a44eea6c44247d0a40f007026b1fb93'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:04.690471 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a44eea6c44247d0a40f007026b1fb93'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:04.704099 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-d4d7605c-c156-4fa3-8721-cec0d86038e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a44eea6c44247d0a40f007026b1fb93'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:04.711175 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1406/2810] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:17:04 2022] DELETE /identity/v3/users/6a44eea6c44247d0a40f007026b1fb93 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:17:04.988960 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:05.005154 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523faaee-7020-41f3-b26d-b02884638b9f service cinder] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:05.062895 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:05.063892 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:05.064206 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:05.064482 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] PATH_INFO: `/v3/projects/dfdaf77bcf5a4358b657de79f178fa6e` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:05.065674 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdaf77bcf5a4358b657de79f178fa6e)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:05.067573 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:05.228120 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdaf77bcf5a4358b657de79f178fa6e', 'request_id': 'req-d81c49e2-05a0-4b03-9795-2c3f1da78311'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:05.233363 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdaf77bcf5a4358b657de79f178fa6e', 'request_id': 'req-d81c49e2-05a0-4b03-9795-2c3f1da78311'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:05.340861 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdaf77bcf5a4358b657de79f178fa6e', 'request_id': 'req-d81c49e2-05a0-4b03-9795-2c3f1da78311'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:05.353372 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] The token cache is being invalidate because project dfdaf77bcf5a4358b657de79f178fa6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79743) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:17:05.353657 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:05.354295 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:17:05.355880 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1405/2811] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:17:04 2022] DELETE /identity/v3/projects/dfdaf77bcf5a4358b657de79f178fa6e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:17:09.222662 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] REQUEST_METHOD: `POST` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:09.223531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:09.223531 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:09.242854 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.auth.core [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] MFA Rules not processed for user `4cdbf7d369e4437eae7a36529d6cd623`. Rule list: `[]` (Enabled: `True`). {{(pid=79742) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 02:17:09.244765 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:09.300605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1407/2812] 10.222.0.79 () {58 vars in 957 bytes} [Fri Jan 28 02:17:09 2022] POST /identity/v3/auth/tokens => generated 3399 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 02:17:09.610312 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:09.611625 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:09.669576 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c49e2-05a0-4b03-9795-2c3f1da78311 admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:09.673280 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:09.673919 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:09.674304 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:09.674665 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:09.676609 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:09.686875 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:09.690778 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:09.697104 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1406/2813] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:17:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:17:10.444473 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:10.445855 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:10.520980 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc0617-68d5-48f8-9a98-426ba49913b7 None None] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:10.526018 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:10.526689 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:10.526974 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:10.527250 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:10.529022 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:10.540943 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:10.542512 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:10.553076 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1408/2814] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:17:10 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:17:26.065285 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:26.066988 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:26.150396 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164b43c-fc74-4fc5-a115-425256e7442e service neutron] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:26.156544 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77dde5aa087649f5873dc17c6fc175c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:26.157204 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:26.157496 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:26.157772 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:26.160592 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:26.173565 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:26.175563 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:26.188441 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1407/2815] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:17:26 2022] GET /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:17:29.227466 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:17:29.237066 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d6178-7fcc-4bce-901c-c23b57ebecaa service placement] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:17:29.240820 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:17:29.241455 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:17:29.241742 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:17:29.242019 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:17:29.243797 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:17:29.305869 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:17:29.307301 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:17:29.316850 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1409/2816] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:17:29 2022] GET /identity/v3/auth/tokens => generated 3464 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:19:23.841044 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:23.843313 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:23.951856 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1197f8-7bde-46e7-996a-ec4797c25a6f service nova] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:23.964603 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37e4ba18870847e8bf97f9ed25771af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:23.965670 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] REQUEST_METHOD: `GET` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:23.966173 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:23.966667 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:23.969386 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:23.984045 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:23.985620 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:23.995693 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1408/2817] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:19:23 2022] GET /identity/v3/auth/tokens => generated 3451 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:19:27.585210 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:27.614964 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f09086-c316-42e1-91b9-01b2cdcb00fd service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:27.618693 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f23bd8046049038d1a5543cce545e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd796d5575de4460e8b6746aa9eba151d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:27.619336 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] REQUEST_METHOD: `GET` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:27.619615 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:27.619928 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:27.622605 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:27.718041 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:27.719391 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:27.740463 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1410/2818] 10.222.0.79 () {60 vars in 1365 bytes} [Fri Jan 28 02:19:27 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 02:19:35.579218 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:35.580659 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:35.594968 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd25d4f-169f-47aa-9957-5263d29c9328 service placement] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:35.599835 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:35.600723 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:35.601009 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:35.601286 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] PATH_INFO: `/v3/users/4cdbf7d369e4437eae7a36529d6cd623` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:35.602525 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cdbf7d369e4437eae7a36529d6cd623)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:35.604715 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:35.842181 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cdbf7d369e4437eae7a36529d6cd623'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:35.848974 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cdbf7d369e4437eae7a36529d6cd623'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:35.860569 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cdbf7d369e4437eae7a36529d6cd623'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:35.926638 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cdbf7d369e4437eae7a36529d6cd623'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:35.927270 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cdbf7d369e4437eae7a36529d6cd623'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:35.934661 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1409/2819] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:19:35 2022] DELETE /identity/v3/users/4cdbf7d369e4437eae7a36529d6cd623 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:19:36.167166 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:36.177913 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3028-54a0-49fc-b8d7-f6bcb83e6329 service neutron] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:36.236816 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:36.237650 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:36.237930 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:36.238201 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] PATH_INFO: `/v3/projects/7ed8db325d13496c9a417966e33b10a1` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:36.239364 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed8db325d13496c9a417966e33b10a1)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:36.241285 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:36.350101 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed8db325d13496c9a417966e33b10a1', 'request_id': 'req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.356403 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed8db325d13496c9a417966e33b10a1', 'request_id': 'req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.439934 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed8db325d13496c9a417966e33b10a1', 'request_id': 'req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.451208 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] The token cache is being invalidate because project 7ed8db325d13496c9a417966e33b10a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:19:36.451497 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.452170 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.453709 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1411/2820] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:19:36 2022] DELETE /identity/v3/projects/7ed8db325d13496c9a417966e33b10a1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:19:36.457708 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Authenticating user token {{(pid=79743) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:36.459106 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.fernet_utils [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79743) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:36.473268 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252c7e-f733-432e-a9b4-9f266149022a admin admin] Validating token access rules against request {{(pid=79743) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:36.528536 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79743) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:36.529400 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:36.529686 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:36.529961 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] PATH_INFO: `/v3/users/60d52bb66a004c7b876fafb221d6cb0d` {{(pid=79743) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:36.531145 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d52bb66a004c7b876fafb221d6cb0d)` {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:36.533110 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] RBAC: Authorization granted {{(pid=79743) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:36.740054 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d52bb66a004c7b876fafb221d6cb0d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.750930 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d52bb66a004c7b876fafb221d6cb0d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.763384 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d52bb66a004c7b876fafb221d6cb0d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.829058 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d52bb66a004c7b876fafb221d6cb0d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.829671 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: DEBUG keystone.notifications [None req-a8b521b1-9dc7-450b-b5f4-d09bf79ade8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d52bb66a004c7b876fafb221d6cb0d'} {{(pid=79743) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:36.835819 dv-cinder-824977-1-iscsi devstack@keystone.service[79743]: [pid: 79743|app: 0|req: 1410/2821] 10.222.0.79 () {58 vars in 1223 bytes} [Fri Jan 28 02:19:36 2022] DELETE /identity/v3/users/60d52bb66a004c7b876fafb221d6cb0d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 02:19:37.117333 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Authenticating user token {{(pid=79742) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 02:19:37.121883 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.fernet_utils [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79742) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 02:19:37.132834 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9fa4-afe4-4f1f-88ea-3706673d804b admin admin] Validating token access rules against request {{(pid=79742) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 02:19:37.194505 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3562fb362d174fe499304c112522dca6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ed384f6c4594ad68721f19ac9473b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79742) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 02:19:37.195348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 02:19:37.195625 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 02:19:37.195896 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] PATH_INFO: `/v3/projects/241a59488666455e8498e7c5010fa09f` {{(pid=79742) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 02:19:37.197103 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=241a59488666455e8498e7c5010fa09f)` {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 02:19:37.198986 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] RBAC: Authorization granted {{(pid=79742) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 02:19:37.285176 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241a59488666455e8498e7c5010fa09f', 'request_id': 'req-5b725c5d-c6f5-453d-85c6-b61718fffdbf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:37.291952 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241a59488666455e8498e7c5010fa09f', 'request_id': 'req-5b725c5d-c6f5-453d-85c6-b61718fffdbf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:37.355472 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241a59488666455e8498e7c5010fa09f', 'request_id': 'req-5b725c5d-c6f5-453d-85c6-b61718fffdbf'} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:37.366122 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] The token cache is being invalidate because project 241a59488666455e8498e7c5010fa09f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79742) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 02:19:37.366348 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:37.366976 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: DEBUG keystone.notifications [None req-5b725c5d-c6f5-453d-85c6-b61718fffdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79742) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 02:19:37.368546 dv-cinder-824977-1-iscsi devstack@keystone.service[79742]: [pid: 79742|app: 0|req: 1412/2822] 10.222.0.79 () {58 vars in 1232 bytes} [Fri Jan 28 02:19:37 2022] DELETE /identity/v3/projects/241a59488666455e8498e7c5010fa09f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)